Jul 01 17:39:07.379979 ip-10-0-140-89 systemd[1]: Starting Kubernetes Kubelet... Jul 01 17:39:07.747324 ip-10-0-140-89 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:39:07.747324 ip-10-0-140-89 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 17:39:07.747324 ip-10-0-140-89 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:39:07.747324 ip-10-0-140-89 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 17:39:07.747324 ip-10-0-140-89 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:39:07.749525 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.749451 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 17:39:07.754233 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754219 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:07.754233 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754234 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754238 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754241 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754244 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754246 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754249 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754252 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754254 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754257 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754259 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754262 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754264 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754267 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754269 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754272 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754274 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754277 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754280 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754283 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754285 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:07.754295 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754288 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754290 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754293 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754295 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754297 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754300 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754303 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754306 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754309 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754311 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754314 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754317 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754319 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754322 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754324 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754326 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754329 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754331 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754334 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:07.754780 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754336 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754339 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754341 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754346 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754349 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754352 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754355 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754358 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754361 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754364 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754367 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754370 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754373 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754375 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754378 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754381 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754384 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754387 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754390 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:07.755345 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754393 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754395 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754398 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754400 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754403 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754407 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754410 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754412 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754415 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754418 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754421 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754423 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754428 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754430 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754433 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754435 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754437 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754440 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754442 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754445 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:07.756126 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754448 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754450 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754453 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754455 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754458 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754461 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754463 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754466 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754469 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754471 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754474 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754476 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754479 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754481 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754484 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754486 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754489 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754491 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754494 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.754496 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:07.756662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756568 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756583 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756588 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756594 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756599 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756604 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756609 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756613 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756619 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756624 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756629 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756657 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756664 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756669 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756674 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756680 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756685 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756690 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756696 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756700 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:07.757150 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756705 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756709 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756713 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756717 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756722 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756726 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756731 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756736 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756740 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756744 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756748 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756751 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756755 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756763 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756769 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756773 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756777 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756781 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756785 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756789 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:07.757802 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756793 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756797 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756802 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756806 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756810 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756814 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756818 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756822 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756828 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756835 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756841 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756846 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756850 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756855 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756859 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756863 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756867 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756873 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756879 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:07.758343 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756883 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756888 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756891 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756895 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756900 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756904 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756910 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756914 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756918 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756922 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756926 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756932 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756937 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756942 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756946 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756950 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756954 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756959 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756962 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:07.758827 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756966 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756971 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756975 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756980 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756984 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756989 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756994 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.756997 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757001 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757005 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757009 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757013 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757017 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757021 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757026 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757030 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757035 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757039 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757042 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757048 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:07.759293 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757053 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757598 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757606 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757610 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757614 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757618 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757622 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757626 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757629 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757632 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757635 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757637 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757660 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757663 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757666 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757668 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757671 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757675 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757677 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757680 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:07.759784 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757682 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757685 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757687 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757689 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757692 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757694 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757697 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757699 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757701 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757704 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757706 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757712 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757714 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757717 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757720 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757723 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757725 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757728 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757730 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:07.760279 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757733 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757736 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757738 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757740 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757743 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757745 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757748 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757751 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757753 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757755 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757758 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757761 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757763 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757766 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757768 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757770 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757773 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757775 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757777 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757780 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:07.760764 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757785 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757788 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757791 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757794 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757801 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757806 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757809 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757811 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757814 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757818 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757821 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757824 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757827 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757830 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757832 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757835 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757837 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757840 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757842 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:07.761263 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757845 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757847 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757850 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757854 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757858 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757861 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757864 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757866 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757869 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757871 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757874 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757876 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757879 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757881 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757883 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757886 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757889 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757892 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757895 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757897 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:07.761834 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757900 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.757902 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.757964 2557 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.757970 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.757977 2557 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.757981 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.757985 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.757988 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.757991 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.757995 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.757998 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758001 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758004 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758007 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758010 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758013 2557 flags.go:64] FLAG: --cgroup-root="" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758016 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758019 2557 flags.go:64] FLAG: --client-ca-file="" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758023 2557 flags.go:64] FLAG: --cloud-provider="external" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758025 2557 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758029 2557 flags.go:64] FLAG: --cluster-domain="" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758032 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758035 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758037 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 17:39:07.762322 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758041 2557 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758044 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758047 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758050 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758053 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758056 2557 flags.go:64] FLAG: --contention-profiling="false" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758059 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758062 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758065 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758068 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758072 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758075 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758078 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758081 2557 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758083 2557 flags.go:64] FLAG: --enable-server="true" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758086 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758091 2557 flags.go:64] FLAG: --event-burst="100" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758094 2557 flags.go:64] FLAG: --event-qps="50" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758096 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758099 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758102 2557 flags.go:64] FLAG: --eviction-hard="" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758111 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758114 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758116 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758119 2557 flags.go:64] FLAG: --eviction-soft="" Jul 01 17:39:07.762921 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758122 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758124 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758128 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758131 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758133 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758136 2557 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758139 2557 flags.go:64] FLAG: --feature-gates="" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758142 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758145 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758148 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758150 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758154 2557 flags.go:64] FLAG: --healthz-port="10248" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758156 2557 flags.go:64] FLAG: --help="false" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758159 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-140-89.ec2.internal" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758162 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758165 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758167 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758170 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758173 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758176 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758179 2557 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758181 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758183 2557 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 17:39:07.763508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758186 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758189 2557 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758192 2557 flags.go:64] FLAG: --kube-reserved="" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758194 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758197 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758199 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758202 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758205 2557 flags.go:64] FLAG: --lock-file="" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758207 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758210 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758212 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758218 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758221 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758223 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758226 2557 flags.go:64] FLAG: --logging-format="text" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758228 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758231 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758234 2557 flags.go:64] FLAG: --manifest-url="" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758237 2557 flags.go:64] FLAG: --manifest-url-header="" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758241 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758243 2557 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758247 2557 flags.go:64] FLAG: --max-pods="110" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758250 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758253 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758255 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 17:39:07.764154 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758258 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758261 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758263 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758266 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758273 2557 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758275 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758278 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758281 2557 flags.go:64] FLAG: --pod-cidr="" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758283 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758288 2557 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758291 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758294 2557 flags.go:64] FLAG: --pods-per-core="0" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758296 2557 flags.go:64] FLAG: --port="10250" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758299 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758302 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00f94786975c8ab84" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758305 2557 flags.go:64] FLAG: --qos-reserved="" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758307 2557 flags.go:64] FLAG: --read-only-port="10255" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758310 2557 flags.go:64] FLAG: --register-node="true" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758313 2557 flags.go:64] FLAG: --register-with-taints="" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758317 2557 flags.go:64] FLAG: --registry-burst="10" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758321 2557 flags.go:64] FLAG: --registry-qps="5" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758323 2557 flags.go:64] FLAG: --reserved-cpus="" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758326 2557 flags.go:64] FLAG: --reserved-memory="" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758329 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758332 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 17:39:07.764799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758335 2557 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758337 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758340 2557 flags.go:64] FLAG: --runonce="false" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758343 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758345 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758349 2557 flags.go:64] FLAG: --seccomp-default="false" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758352 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758355 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758358 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758361 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758364 2557 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758367 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758369 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758372 2557 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758375 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758377 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758380 2557 flags.go:64] FLAG: --system-cgroups="" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758383 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758388 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758390 2557 flags.go:64] FLAG: --tls-cert-file="" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758393 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758396 2557 flags.go:64] FLAG: --tls-min-version="" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758399 2557 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758401 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758404 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 17:39:07.765406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758407 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758411 2557 flags.go:64] FLAG: --v="2" Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758414 2557 flags.go:64] FLAG: --version="false" Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758418 2557 flags.go:64] FLAG: --vmodule="" Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758422 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758425 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758532 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758535 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758538 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758541 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758544 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758547 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758550 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758553 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758556 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758558 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758560 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758563 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758567 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758570 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758573 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:07.766017 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758576 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758579 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758581 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758584 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758587 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758589 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758591 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758594 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758597 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758599 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758602 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758604 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758608 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758611 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758613 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758617 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758619 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758621 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758624 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758627 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:07.766525 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758629 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758632 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758634 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758656 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758662 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758665 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758667 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758670 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758673 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758676 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758679 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758681 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758684 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758687 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758689 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758692 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758695 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758697 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758699 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:07.767025 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758702 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758704 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758707 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758709 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758712 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758715 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758718 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758721 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758723 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758726 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758729 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758731 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758734 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758737 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758739 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758741 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758745 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758747 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758750 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758752 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:07.767512 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758755 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758758 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758760 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758763 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758766 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758769 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758773 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758776 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758778 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758780 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758783 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758785 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758787 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758790 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758792 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758795 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758797 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758800 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758803 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758805 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:07.768019 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758808 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758810 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758813 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758816 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.758818 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.758823 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.765356 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.765371 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.765390 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.765396 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765448 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765452 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765455 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765458 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765461 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:07.768504 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765464 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765467 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765469 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765472 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765474 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765477 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765479 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765482 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765484 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765487 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765489 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765492 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765495 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765497 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765499 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765502 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765504 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765507 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765509 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:07.768997 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765513 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765517 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765520 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765523 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765525 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765532 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765536 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765538 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765541 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765544 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765546 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765549 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765551 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765554 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765556 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765559 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765562 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765564 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765567 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765569 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:07.769461 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765572 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765574 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765576 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765579 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765581 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765584 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765586 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765588 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765591 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765593 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765595 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765598 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765600 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765602 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765605 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765607 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765610 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765613 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765616 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765619 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:07.769962 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765621 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765624 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765626 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765628 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765631 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765633 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765636 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765638 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765656 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765659 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765661 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765664 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765666 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765669 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765673 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765676 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765679 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765682 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765684 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:07.770452 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765687 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765690 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765693 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765695 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765698 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765700 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765703 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765707 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765710 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765713 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765716 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765719 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765722 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765725 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765727 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:07.770952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765729 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.765735 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765841 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765846 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765849 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765851 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765854 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765857 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765860 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765863 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765865 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765868 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765871 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765873 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:07.771312 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765876 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765878 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765881 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765883 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765886 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765889 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765891 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765894 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765896 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765899 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765901 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765904 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765907 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765910 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765912 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765915 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765918 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765921 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765923 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765925 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:07.771659 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765928 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765930 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765932 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765935 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765937 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765940 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765942 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765944 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765947 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765949 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765951 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765954 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765956 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765958 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765961 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765963 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765965 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765968 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765970 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765973 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:07.772134 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765975 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765977 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765980 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765982 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765984 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765987 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765989 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765992 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765996 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.765999 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766002 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766005 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766008 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766011 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766014 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766017 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766019 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766022 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766025 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:07.772624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766027 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766030 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766033 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766035 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766037 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766040 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766042 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766045 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766047 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766049 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766052 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766054 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766057 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766059 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766061 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766063 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766066 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766068 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766071 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766073 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:07.773136 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766075 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766078 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766080 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766083 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766085 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766088 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766090 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:07.766092 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.766097 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.766184 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.768223 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.769896 2557 server.go:1019] "Starting client certificate rotation" Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.770000 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 17:39:07.773603 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.770032 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 17:39:07.773942 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.772274 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 17:39:07.773942 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.773670 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 17:39:07.788100 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.788085 2557 log.go:25] "Validated CRI v1 runtime API" Jul 01 17:39:07.791670 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.791638 2557 log.go:25] "Validated CRI v1 image API" Jul 01 17:39:07.792493 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.792477 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 17:39:07.796608 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.796589 2557 fs.go:135] Filesystem UUIDs: map[4b4d50b0-840c-4ea9-84df-1fb81e1cf049:/dev/nvme0n1p3 4f01e65d-6456-4c1c-af0e-6fe63f0dab1e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 01 17:39:07.796700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.796607 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 17:39:07.800459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.800441 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 17:39:07.801371 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.801267 2557 manager.go:216] Machine: {Timestamp:2026-07-01 17:39:07.800048404 +0000 UTC m=+0.307700003 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098708 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec242e9e8d1bcf4c5172f0b9d459f974 SystemUUID:ec242e9e-8d1b-cf4c-5172-f0b9d459f974 BootID:44d17785-4236-4702-8ceb-ac6f7a8fc997 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:be:9c:c6:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:be:9c:c6:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:54:e3:db:0b:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 17:39:07.801371 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.801368 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 17:39:07.801480 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.801434 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 17:39:07.804308 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.804283 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 17:39:07.804483 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.804311 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-89.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 17:39:07.805797 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.805785 2557 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 17:39:07.805854 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.805803 2557 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 17:39:07.805854 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.805814 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 17:39:07.806516 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.806504 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 17:39:07.807455 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.807443 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 17:39:07.811584 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.811570 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 01 17:39:07.811729 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.811718 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 17:39:07.811786 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.811757 2557 kubelet.go:486] "Attempting to sync node with API server" Jul 01 17:39:07.811786 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.811772 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 17:39:07.811877 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.811787 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 17:39:07.811877 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.811801 2557 kubelet.go:398] "Adding apiserver pod source" Jul 01 17:39:07.811877 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.811813 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 17:39:07.812195 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.812179 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 17:39:07.812277 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.812203 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 17:39:07.814119 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.814101 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 17:39:07.815497 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.815480 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 17:39:07.815547 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.815515 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 17:39:07.815688 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.815678 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 17:39:07.815719 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.815693 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 17:39:07.815719 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.815699 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 17:39:07.815719 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.815704 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 17:39:07.815719 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.815712 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 17:39:07.815719 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.815718 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 17:39:07.816273 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.816265 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 17:39:07.816273 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.816273 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 17:39:07.816335 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.816286 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 17:39:07.816335 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.816292 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 17:39:07.816335 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.816305 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 17:39:07.816335 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.816313 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 17:39:07.817429 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.817419 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 17:39:07.817465 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.817431 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 17:39:07.820404 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.820391 2557 server.go:1268] "Started kubelet" Jul 01 17:39:07.820496 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.820472 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 17:39:07.820578 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.820543 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 17:39:07.820635 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.820600 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 17:39:07.821623 ip-10-0-140-89 systemd[1]: Started Kubernetes Kubelet. Jul 01 17:39:07.821765 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.821738 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 17:39:07.823192 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.823176 2557 server.go:310] "Adding debug handlers to kubelet server" Jul 01 17:39:07.823946 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.823913 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 17:39:07.824069 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.824001 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-89.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 17:39:07.824180 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.824150 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 17:39:07.828004 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.827983 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 17:39:07.828210 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.828194 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w52lr" Jul 01 17:39:07.829923 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.829055 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-89.ec2.internal.18be3b288c174de2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-89.ec2.internal,UID:ip-10-0-140-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-89.ec2.internal,},FirstTimestamp:2026-07-01 17:39:07.820363234 +0000 UTC m=+0.328014833,LastTimestamp:2026-07-01 17:39:07.820363234 +0000 UTC m=+0.328014833,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-89.ec2.internal,}" Jul 01 17:39:07.834258 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.834240 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 17:39:07.834358 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.834255 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 17:39:07.834358 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.834311 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:07.835075 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835057 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 17:39:07.835165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835062 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 17:39:07.835213 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835203 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 17:39:07.835265 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835110 2557 factory.go:55] Registering systemd factory Jul 01 17:39:07.835265 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835259 2557 factory.go:223] Registration of the systemd container factory successfully Jul 01 17:39:07.835360 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835349 2557 reconstruct.go:97] "Volume reconstruction finished" Jul 01 17:39:07.835406 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835361 2557 reconciler.go:29] "Reconciler: start to sync state" Jul 01 17:39:07.835513 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835497 2557 factory.go:153] Registering CRI-O factory Jul 01 17:39:07.835552 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835518 2557 factory.go:223] Registration of the crio container factory successfully Jul 01 17:39:07.835592 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835568 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 17:39:07.835592 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835591 2557 factory.go:103] Registering Raw factory Jul 01 17:39:07.835748 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.835603 2557 manager.go:1196] Started watching for new ooms in manager Jul 01 17:39:07.836020 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.836009 2557 manager.go:349] Starting recovery of all containers Jul 01 17:39:07.836709 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.836683 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 17:39:07.837668 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.836883 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 17:39:07.837668 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.837085 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w52lr" Jul 01 17:39:07.846210 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.846087 2557 manager.go:354] Recovery completed Jul 01 17:39:07.850590 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.850578 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:07.852403 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.852389 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:07.852467 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.852424 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:07.852467 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.852444 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:07.853046 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.853034 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 17:39:07.853046 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.853045 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 17:39:07.853177 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.853061 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 01 17:39:07.853177 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.853126 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:07.853843 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.853826 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:07.853899 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.853854 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:07.853899 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.853863 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:07.855159 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.855145 2557 policy_none.go:49] "None policy: Start" Jul 01 17:39:07.855240 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.855164 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 17:39:07.855240 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.855177 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 17:39:07.857261 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.857246 2557 policy_none.go:47] "Start" Jul 01 17:39:07.898228 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.898213 2557 manager.go:337] "Starting Device Plugin manager" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.898241 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.898249 2557 server.go:87] "Starting device plugin registration server" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.898447 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.898459 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.898659 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.898742 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.898752 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.899162 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.899205 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.905444 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.906772 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.906811 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.906827 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:07.906861 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 17:39:07.918098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.908859 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:07.999240 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:07.999190 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:08.000159 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.000144 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:08.000247 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.000184 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:08.000247 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.000201 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:08.000247 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.000230 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.007293 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.007277 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal"] Jul 01 17:39:08.007355 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.007331 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:08.008057 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.008041 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:08.008103 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.008069 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:08.008103 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.008085 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:08.010400 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.010389 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:08.010518 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.010505 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.010568 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.010532 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:08.011097 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.011081 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:08.011165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.011098 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:08.011165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.011113 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:08.011165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.011120 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:08.011165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.011125 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:08.011165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.011132 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:08.011715 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.011697 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.011796 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.011720 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-89.ec2.internal\": node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:08.013247 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.013233 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.013334 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.013255 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:08.013898 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.013881 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:08.013982 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.013916 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:08.013982 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.013931 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:08.033250 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.033235 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:08.036552 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.036538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67b7fa50d98634df2a86c93306215d81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal\" (UID: \"67b7fa50d98634df2a86c93306215d81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.036614 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.036560 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67b7fa50d98634df2a86c93306215d81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal\" (UID: \"67b7fa50d98634df2a86c93306215d81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.036614 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.036577 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a26dcbe7740a0418a5dbe53bf94c782-config\") pod \"kube-apiserver-proxy-ip-10-0-140-89.ec2.internal\" (UID: \"7a26dcbe7740a0418a5dbe53bf94c782\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.043199 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.043184 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-89.ec2.internal\" not found" node="ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.047563 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.047535 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-89.ec2.internal\" not found" node="ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.133844 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.133811 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:08.137104 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.137088 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67b7fa50d98634df2a86c93306215d81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal\" (UID: \"67b7fa50d98634df2a86c93306215d81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.137172 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.137114 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67b7fa50d98634df2a86c93306215d81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal\" (UID: \"67b7fa50d98634df2a86c93306215d81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.137172 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.137129 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a26dcbe7740a0418a5dbe53bf94c782-config\") pod \"kube-apiserver-proxy-ip-10-0-140-89.ec2.internal\" (UID: \"7a26dcbe7740a0418a5dbe53bf94c782\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.137172 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.137165 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a26dcbe7740a0418a5dbe53bf94c782-config\") pod \"kube-apiserver-proxy-ip-10-0-140-89.ec2.internal\" (UID: \"7a26dcbe7740a0418a5dbe53bf94c782\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.137301 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.137202 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67b7fa50d98634df2a86c93306215d81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal\" (UID: \"67b7fa50d98634df2a86c93306215d81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.137301 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.137206 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67b7fa50d98634df2a86c93306215d81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal\" (UID: \"67b7fa50d98634df2a86c93306215d81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.234134 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.234111 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:08.334287 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.334216 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:08.347575 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.347554 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.350708 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.350692 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal" Jul 01 17:39:08.434742 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.434705 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:08.535161 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.535128 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:08.635527 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.635502 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:08.735988 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.735967 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:08.769263 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.769245 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 17:39:08.769763 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.769382 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 17:39:08.797901 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.797881 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:08.836592 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.836570 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:08.842830 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.842806 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 17:34:08 +0000 UTC" deadline="2027-12-10 20:00:14.419674918 +0000 UTC" Jul 01 17:39:08.842830 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:08.842829 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12650h21m5.576849231s" Jul 01 17:39:08.936867 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:08.936849 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:09.037358 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:09.037334 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:09.041176 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:09.041139 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a26dcbe7740a0418a5dbe53bf94c782.slice/crio-16f07d99b3bdcfd13ae194d055063a5a09cea3dbde998bece0f7f53a7793d694 WatchSource:0}: Error finding container 16f07d99b3bdcfd13ae194d055063a5a09cea3dbde998bece0f7f53a7793d694: Status 404 returned error can't find the container with id 16f07d99b3bdcfd13ae194d055063a5a09cea3dbde998bece0f7f53a7793d694 Jul 01 17:39:09.048924 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.048904 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:39:09.072412 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:09.072395 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b7fa50d98634df2a86c93306215d81.slice/crio-22ca564f92fc7def50f619986df6b4fe40383c8ee8273aceac1b689e37f51b35 WatchSource:0}: Error finding container 22ca564f92fc7def50f619986df6b4fe40383c8ee8273aceac1b689e37f51b35: Status 404 returned error can't find the container with id 22ca564f92fc7def50f619986df6b4fe40383c8ee8273aceac1b689e37f51b35 Jul 01 17:39:09.137948 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:09.137925 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:09.238453 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:09.238397 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-89.ec2.internal\" not found" Jul 01 17:39:09.318161 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.318141 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:09.334702 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.334678 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" Jul 01 17:39:09.347710 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.347692 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 17:39:09.348789 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.348778 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal" Jul 01 17:39:09.358383 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.358369 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 17:39:09.363703 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.363688 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:09.592668 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.592576 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:09.813311 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.813280 2557 apiserver.go:52] "Watching apiserver" Jul 01 17:39:09.827866 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.827838 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 17:39:09.828505 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.828476 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq","openshift-image-registry/node-ca-qkp44","openshift-multus/multus-additional-cni-plugins-tzwq5","openshift-network-operator/iptables-alerter-v4hs2","openshift-ovn-kubernetes/ovnkube-node-z4tzt","kube-system/konnectivity-agent-n77l4","kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal","openshift-cluster-node-tuning-operator/tuned-crfq6","openshift-dns/node-resolver-b7zv7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal","openshift-multus/multus-tsmc7","openshift-multus/network-metrics-daemon-qvjbt","openshift-network-diagnostics/network-check-target-wq6jk","kube-system/global-pull-secret-syncer-nh728"] Jul 01 17:39:09.831347 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.831295 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:09.831477 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:09.831384 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:09.833798 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.833750 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:09.834829 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.834802 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 17:39:09.838057 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.838036 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.838234 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.838215 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 17:39:09.838538 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.838516 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d4p9j\"" Jul 01 17:39:09.839776 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.839391 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 17:39:09.839776 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.839577 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 17:39:09.839776 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.839735 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:09.841793 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.841739 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 17:39:09.841888 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.841815 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 17:39:09.841991 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.841967 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 17:39:09.842323 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.842303 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 17:39:09.843442 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.843391 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.844047 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844025 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:39:09.844226 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844211 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 17:39:09.844403 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844387 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 17:39:09.844557 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844536 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.844627 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844573 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5872131c-cc29-4fa7-8687-a9658d15532b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.844627 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844601 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-os-release\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.844752 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844628 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-system-cni-dir\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.844752 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxhmg\" (UniqueName: \"kubernetes.io/projected/5872131c-cc29-4fa7-8687-a9658d15532b-kube-api-access-fxhmg\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.844752 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844679 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v6hv\" (UniqueName: \"kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv\") pod \"network-check-target-wq6jk\" (UID: \"7cbfd800-dc00-43a9-9ece-aebf1e56c67c\") " pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:09.844752 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61e0159e-4247-4c24-9783-f9cd8c368db9-host\") pod \"node-ca-qkp44\" (UID: \"61e0159e-4247-4c24-9783-f9cd8c368db9\") " pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:09.844752 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844712 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 17:39:09.844752 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844748 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61e0159e-4247-4c24-9783-f9cd8c368db9-serviceca\") pod \"node-ca-qkp44\" (UID: \"61e0159e-4247-4c24-9783-f9cd8c368db9\") " pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:09.845113 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xk4f\" (UniqueName: \"kubernetes.io/projected/61e0159e-4247-4c24-9783-f9cd8c368db9-kube-api-access-6xk4f\") pod \"node-ca-qkp44\" (UID: \"61e0159e-4247-4c24-9783-f9cd8c368db9\") " pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:09.845113 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844798 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-cnibin\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.845113 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844821 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5872131c-cc29-4fa7-8687-a9658d15532b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.845113 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844846 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5872131c-cc29-4fa7-8687-a9658d15532b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.845113 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.844956 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w46nj\"" Jul 01 17:39:09.845113 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.845026 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zs24j\"" Jul 01 17:39:09.845866 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.845605 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:09.846443 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.846421 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 17:39:09.846663 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.846645 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 17:39:09.848773 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.848756 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 17:39:09.849109 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.849073 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 17:39:09.849202 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.849120 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:09.849266 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.849209 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dv826\"" Jul 01 17:39:09.849386 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.849366 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 17:39:09.849713 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.849547 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-frmdj\"" Jul 01 17:39:09.849713 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.849708 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 17:39:09.850060 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.850041 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 17:39:09.851524 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.850738 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.851524 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.851389 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 17:39:09.854127 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.854106 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 17:39:09.854281 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.854252 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l6kqh\"" Jul 01 17:39:09.854355 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.854328 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 17:39:09.854454 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.854111 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:09.854538 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.854519 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 17:39:09.854607 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.854556 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:39:09.854785 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.854767 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 17:39:09.855190 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.855167 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 17:39:09.855253 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.855169 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fxsxv\"" Jul 01 17:39:09.856907 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.856889 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:09.857004 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:09.856955 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:09.860006 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.859987 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.862361 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.862340 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:09.862447 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:09.862407 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:09.862813 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.862796 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 17:39:09.863535 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.863516 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l72nc\"" Jul 01 17:39:09.863806 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.863787 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tj5rz\"" Jul 01 17:39:09.864128 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.864110 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 17:39:09.864321 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.864306 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 17:39:09.888119 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.888096 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-csjj9" Jul 01 17:39:09.896851 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.896824 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-csjj9" Jul 01 17:39:09.917342 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.917274 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" event={"ID":"67b7fa50d98634df2a86c93306215d81","Type":"ContainerStarted","Data":"22ca564f92fc7def50f619986df6b4fe40383c8ee8273aceac1b689e37f51b35"} Jul 01 17:39:09.918583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.918560 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal" event={"ID":"7a26dcbe7740a0418a5dbe53bf94c782","Type":"ContainerStarted","Data":"16f07d99b3bdcfd13ae194d055063a5a09cea3dbde998bece0f7f53a7793d694"} Jul 01 17:39:09.936488 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.936459 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 17:39:09.945886 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.945859 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4gdz\" (UniqueName: \"kubernetes.io/projected/feb31a59-2375-4790-a4cf-ed314aee2605-kube-api-access-w4gdz\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:09.945998 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.945902 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-lib-modules\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.945998 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.945930 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbpml\" (UniqueName: \"kubernetes.io/projected/61679b19-c91b-4240-b22b-4b767b5407bc-kube-api-access-vbpml\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.945998 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.945969 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6hv\" (UniqueName: \"kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv\") pod \"network-check-target-wq6jk\" (UID: \"7cbfd800-dc00-43a9-9ece-aebf1e56c67c\") " pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:09.945998 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.945996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-var-lib-cni-multus\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.946211 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946015 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.946211 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946039 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.946211 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946076 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-ovn-node-metrics-cert\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.946211 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-ovnkube-script-lib\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.946211 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946132 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-hostroot\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.946211 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946153 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-sysconfig\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.946211 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946179 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-run-openvswitch\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.946211 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946204 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-socket-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946227 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946235 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-system-cni-dir\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946280 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-log-socket\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946323 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-ovnkube-config\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946333 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-system-cni-dir\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946362 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/773871da-d67a-452f-8acc-b169f6dd8711-agent-certs\") pod \"konnectivity-agent-n77l4\" (UID: \"773871da-d67a-452f-8acc-b169f6dd8711\") " pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946393 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-device-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946420 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61679b19-c91b-4240-b22b-4b767b5407bc-tmp\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946446 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-etc-openvswitch\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946483 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61e0159e-4247-4c24-9783-f9cd8c368db9-host\") pod \"node-ca-qkp44\" (UID: \"61e0159e-4247-4c24-9783-f9cd8c368db9\") " pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946507 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5872131c-cc29-4fa7-8687-a9658d15532b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946524 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8829ddc0-02b1-483f-8009-73c4c83f6935-tmp-dir\") pod \"node-resolver-b7zv7\" (UID: \"8829ddc0-02b1-483f-8009-73c4c83f6935\") " pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946540 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-var-lib-cni-bin\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946564 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/61679b19-c91b-4240-b22b-4b767b5407bc-etc-tuned\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.946583 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946584 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946586 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61e0159e-4247-4c24-9783-f9cd8c368db9-host\") pod \"node-ca-qkp44\" (UID: \"61e0159e-4247-4c24-9783-f9cd8c368db9\") " pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946601 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7h7x\" (UniqueName: \"kubernetes.io/projected/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-kube-api-access-l7h7x\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946616 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-modprobe-d\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946640 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/35e8d50c-f601-4840-8909-8d462a7d6953-dbus\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946682 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhmg\" (UniqueName: \"kubernetes.io/projected/5872131c-cc29-4fa7-8687-a9658d15532b-kube-api-access-fxhmg\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946710 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc-iptables-alerter-script\") pod \"iptables-alerter-v4hs2\" (UID: \"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc\") " pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946732 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-node-log\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk4qs\" (UniqueName: \"kubernetes.io/projected/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-kube-api-access-hk4qs\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946772 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxflf\" (UniqueName: \"kubernetes.io/projected/8829ddc0-02b1-483f-8009-73c4c83f6935-kube-api-access-rxflf\") pod \"node-resolver-b7zv7\" (UID: \"8829ddc0-02b1-483f-8009-73c4c83f6935\") " pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946820 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-cnibin\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946857 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-run-k8s-cni-cncf-io\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/35e8d50c-f601-4840-8909-8d462a7d6953-kubelet-config\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946912 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61e0159e-4247-4c24-9783-f9cd8c368db9-serviceca\") pod \"node-ca-qkp44\" (UID: \"61e0159e-4247-4c24-9783-f9cd8c368db9\") " pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946940 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xk4f\" (UniqueName: \"kubernetes.io/projected/61e0159e-4247-4c24-9783-f9cd8c368db9-kube-api-access-6xk4f\") pod \"node-ca-qkp44\" (UID: \"61e0159e-4247-4c24-9783-f9cd8c368db9\") " pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946967 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-run-netns\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.946991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8829ddc0-02b1-483f-8009-73c4c83f6935-hosts-file\") pod \"node-resolver-b7zv7\" (UID: \"8829ddc0-02b1-483f-8009-73c4c83f6935\") " pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:09.947352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947016 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-socket-dir-parent\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947054 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-systemd-units\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947084 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-var-lib-openvswitch\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947109 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-run-ovn\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947134 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947152 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5872131c-cc29-4fa7-8687-a9658d15532b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947159 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/773871da-d67a-452f-8acc-b169f6dd8711-konnectivity-ca\") pod \"konnectivity-agent-n77l4\" (UID: \"773871da-d67a-452f-8acc-b169f6dd8711\") " pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-os-release\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-run-systemd\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947291 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-cni-bin\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947307 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-os-release\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947315 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-system-cni-dir\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-os-release\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947363 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-var-lib-kubelet\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947376 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61e0159e-4247-4c24-9783-f9cd8c368db9-serviceca\") pod \"node-ca-qkp44\" (UID: \"61e0159e-4247-4c24-9783-f9cd8c368db9\") " pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947386 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-run\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947419 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-host\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.948291 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947461 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-etc-kubernetes\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947507 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-registration-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947539 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947568 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-sys-fs\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947597 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-systemd\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947619 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947681 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcwkl\" (UniqueName: \"kubernetes.io/projected/e9405216-0c3e-46c9-9d9d-d4904fccd18f-kube-api-access-zcwkl\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947715 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-cnibin\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947732 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5872131c-cc29-4fa7-8687-a9658d15532b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb8dd\" (UniqueName: \"kubernetes.io/projected/77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc-kube-api-access-kb8dd\") pod \"iptables-alerter-v4hs2\" (UID: \"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc\") " pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947775 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-env-overrides\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947793 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-run-multus-certs\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947792 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5872131c-cc29-4fa7-8687-a9658d15532b-cnibin\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947809 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-kubernetes\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947826 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-sysctl-d\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947851 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-sys\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.948875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947884 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc-host-slash\") pod \"iptables-alerter-v4hs2\" (UID: \"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc\") " pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947904 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-kubelet\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947928 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-slash\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-cni-netd\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.947978 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-cni-dir\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.948017 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.948037 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-sysctl-conf\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.948058 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5872131c-cc29-4fa7-8687-a9658d15532b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.948084 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-run-netns\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.948110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-var-lib-kubelet\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.948133 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-cni-binary-copy\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.948158 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-conf-dir\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.948180 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-daemon-config\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.948189 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5872131c-cc29-4fa7-8687-a9658d15532b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.949409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.948541 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5872131c-cc29-4fa7-8687-a9658d15532b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:09.957613 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.957584 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 17:39:09.958091 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:09.958051 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:09.958091 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:09.958083 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:09.958225 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:09.958096 2557 projected.go:196] Error preparing data for projected volume kube-api-access-6v6hv for pod openshift-network-diagnostics/network-check-target-wq6jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:09.958225 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:09.958157 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv podName:7cbfd800-dc00-43a9-9ece-aebf1e56c67c nodeName:}" failed. No retries permitted until 2026-07-01 17:39:10.458136878 +0000 UTC m=+2.965788483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6v6hv" (UniqueName: "kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv") pod "network-check-target-wq6jk" (UID: "7cbfd800-dc00-43a9-9ece-aebf1e56c67c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:09.961918 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.961898 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xk4f\" (UniqueName: \"kubernetes.io/projected/61e0159e-4247-4c24-9783-f9cd8c368db9-kube-api-access-6xk4f\") pod \"node-ca-qkp44\" (UID: \"61e0159e-4247-4c24-9783-f9cd8c368db9\") " pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:09.961999 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:09.961937 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxhmg\" (UniqueName: \"kubernetes.io/projected/5872131c-cc29-4fa7-8687-a9658d15532b-kube-api-access-fxhmg\") pod \"multus-additional-cni-plugins-tzwq5\" (UID: \"5872131c-cc29-4fa7-8687-a9658d15532b\") " pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:10.048902 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.048871 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-etc-kubernetes\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.048902 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.048906 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-registration-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.049165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.048934 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.049165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.048959 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-sys-fs\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.049165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.048989 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-systemd\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.049165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049015 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:10.049165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049050 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcwkl\" (UniqueName: \"kubernetes.io/projected/e9405216-0c3e-46c9-9d9d-d4904fccd18f-kube-api-access-zcwkl\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:10.049165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049082 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb8dd\" (UniqueName: \"kubernetes.io/projected/77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc-kube-api-access-kb8dd\") pod \"iptables-alerter-v4hs2\" (UID: \"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc\") " pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:10.049165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049133 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-env-overrides\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.049165 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049161 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-run-multus-certs\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049185 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-kubernetes\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049211 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-sysctl-d\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049238 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-sys\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049263 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc-host-slash\") pod \"iptables-alerter-v4hs2\" (UID: \"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc\") " pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049288 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-kubelet\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049316 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-slash\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049343 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-cni-netd\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049368 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-cni-dir\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049393 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049414 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-sysctl-conf\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049438 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-run-netns\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-var-lib-kubelet\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049492 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-cni-binary-copy\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.049519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049516 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-conf-dir\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049543 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-daemon-config\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049570 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4gdz\" (UniqueName: \"kubernetes.io/projected/feb31a59-2375-4790-a4cf-ed314aee2605-kube-api-access-w4gdz\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049595 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-lib-modules\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049623 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbpml\" (UniqueName: \"kubernetes.io/projected/61679b19-c91b-4240-b22b-4b767b5407bc-kube-api-access-vbpml\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049667 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-var-lib-cni-multus\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049697 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049737 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-ovn-node-metrics-cert\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049764 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-ovnkube-script-lib\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049794 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-hostroot\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049841 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-sysconfig\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049866 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-run-openvswitch\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049893 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-socket-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049925 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-log-socket\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049950 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-ovnkube-config\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.049976 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/773871da-d67a-452f-8acc-b169f6dd8711-agent-certs\") pod \"konnectivity-agent-n77l4\" (UID: \"773871da-d67a-452f-8acc-b169f6dd8711\") " pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050004 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-device-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.050182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050030 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61679b19-c91b-4240-b22b-4b767b5407bc-tmp\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050057 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-etc-openvswitch\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8829ddc0-02b1-483f-8009-73c4c83f6935-tmp-dir\") pod \"node-resolver-b7zv7\" (UID: \"8829ddc0-02b1-483f-8009-73c4c83f6935\") " pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050111 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-var-lib-cni-bin\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/61679b19-c91b-4240-b22b-4b767b5407bc-etc-tuned\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050164 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050199 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7h7x\" (UniqueName: \"kubernetes.io/projected/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-kube-api-access-l7h7x\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-modprobe-d\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/35e8d50c-f601-4840-8909-8d462a7d6953-dbus\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050290 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc-iptables-alerter-script\") pod \"iptables-alerter-v4hs2\" (UID: \"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc\") " pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050319 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-node-log\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk4qs\" (UniqueName: \"kubernetes.io/projected/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-kube-api-access-hk4qs\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050373 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxflf\" (UniqueName: \"kubernetes.io/projected/8829ddc0-02b1-483f-8009-73c4c83f6935-kube-api-access-rxflf\") pod \"node-resolver-b7zv7\" (UID: \"8829ddc0-02b1-483f-8009-73c4c83f6935\") " pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050401 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-cnibin\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050429 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-run-k8s-cni-cncf-io\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050449 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/35e8d50c-f601-4840-8909-8d462a7d6953-kubelet-config\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050467 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-run-netns\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.050988 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050490 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8829ddc0-02b1-483f-8009-73c4c83f6935-hosts-file\") pod \"node-resolver-b7zv7\" (UID: \"8829ddc0-02b1-483f-8009-73c4c83f6935\") " pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050518 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-socket-dir-parent\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050545 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-systemd-units\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050566 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-var-lib-openvswitch\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050584 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-run-ovn\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050624 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/773871da-d67a-452f-8acc-b169f6dd8711-konnectivity-ca\") pod \"konnectivity-agent-n77l4\" (UID: \"773871da-d67a-452f-8acc-b169f6dd8711\") " pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050654 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-run-systemd\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050681 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-cni-bin\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050708 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-system-cni-dir\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050766 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-os-release\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050791 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-var-lib-kubelet\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050815 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-run\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050842 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-host\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.050970 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-host\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.051012 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-etc-kubernetes\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.051049 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-registration-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.051124 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.051805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.051180 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-sys-fs\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.051233 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-systemd\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.051328 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.051393 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret podName:35e8d50c-f601-4840-8909-8d462a7d6953 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:10.551373955 +0000 UTC m=+3.059025550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret") pod "global-pull-secret-syncer-nh728" (UID: "35e8d50c-f601-4840-8909-8d462a7d6953") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.051811 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-device-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052227 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/35e8d50c-f601-4840-8909-8d462a7d6953-kubelet-config\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052263 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-systemd-units\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052284 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-etc-openvswitch\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052315 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8829ddc0-02b1-483f-8009-73c4c83f6935-hosts-file\") pod \"node-resolver-b7zv7\" (UID: \"8829ddc0-02b1-483f-8009-73c4c83f6935\") " pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052329 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-run-ovn\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052371 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-run-netns\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052374 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052412 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-var-lib-openvswitch\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052416 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-run-systemd\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052448 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-cni-bin\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052457 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-socket-dir-parent\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052504 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-os-release\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.052700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052519 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-var-lib-kubelet\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052540 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-run\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.052610 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.052651 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs podName:e9405216-0c3e-46c9-9d9d-d4904fccd18f nodeName:}" failed. No retries permitted until 2026-07-01 17:39:10.552633792 +0000 UTC m=+3.060285422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs") pod "network-metrics-daemon-qvjbt" (UID: "e9405216-0c3e-46c9-9d9d-d4904fccd18f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052677 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/35e8d50c-f601-4840-8909-8d462a7d6953-dbus\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052704 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-var-lib-cni-bin\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.052795 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8829ddc0-02b1-483f-8009-73c4c83f6935-tmp-dir\") pod \"node-resolver-b7zv7\" (UID: \"8829ddc0-02b1-483f-8009-73c4c83f6935\") " pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053005 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-modprobe-d\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053061 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/773871da-d67a-452f-8acc-b169f6dd8711-konnectivity-ca\") pod \"konnectivity-agent-n77l4\" (UID: \"773871da-d67a-452f-8acc-b169f6dd8711\") " pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053119 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-system-cni-dir\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053343 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-node-log\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053357 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc-iptables-alerter-script\") pod \"iptables-alerter-v4hs2\" (UID: \"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc\") " pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053425 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-cnibin\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053477 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-run-k8s-cni-cncf-io\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053524 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-kubelet\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053527 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-cni-binary-copy\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053621 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-slash\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053670 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-cni-netd\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.053782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053753 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-cni-dir\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053794 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-run-netns\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053840 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-var-lib-kubelet\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053853 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-sysctl-conf\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.053995 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-lib-modules\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054036 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-conf-dir\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054087 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054181 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-sysctl-d\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054225 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-env-overrides\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054226 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-run-multus-certs\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054272 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-kubernetes\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054310 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-sys\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054362 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc-host-slash\") pod \"iptables-alerter-v4hs2\" (UID: \"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc\") " pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054374 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-multus-daemon-config\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054409 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-host-var-lib-cni-multus\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054433 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054499 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-run-openvswitch\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054507 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-log-socket\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.054802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054542 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-hostroot\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.055690 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054611 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/61679b19-c91b-4240-b22b-4b767b5407bc-etc-sysconfig\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.055690 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.054614 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/feb31a59-2375-4790-a4cf-ed314aee2605-socket-dir\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.055690 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.055113 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-ovnkube-config\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.055690 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.055457 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61679b19-c91b-4240-b22b-4b767b5407bc-tmp\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.055690 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.055517 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/61679b19-c91b-4240-b22b-4b767b5407bc-etc-tuned\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.055999 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.055851 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-ovnkube-script-lib\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.056244 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.056222 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/773871da-d67a-452f-8acc-b169f6dd8711-agent-certs\") pod \"konnectivity-agent-n77l4\" (UID: \"773871da-d67a-452f-8acc-b169f6dd8711\") " pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:10.057052 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.057033 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-ovn-node-metrics-cert\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.067223 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.067199 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk4qs\" (UniqueName: \"kubernetes.io/projected/4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2-kube-api-access-hk4qs\") pod \"ovnkube-node-z4tzt\" (UID: \"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.067884 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.067857 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcwkl\" (UniqueName: \"kubernetes.io/projected/e9405216-0c3e-46c9-9d9d-d4904fccd18f-kube-api-access-zcwkl\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:10.068278 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.068259 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb8dd\" (UniqueName: \"kubernetes.io/projected/77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc-kube-api-access-kb8dd\") pod \"iptables-alerter-v4hs2\" (UID: \"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc\") " pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:10.072228 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.072207 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7h7x\" (UniqueName: \"kubernetes.io/projected/02fb1131-5a5f-4faf-8ab0-3d755acb8c2b-kube-api-access-l7h7x\") pod \"multus-tsmc7\" (UID: \"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b\") " pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.074101 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.073883 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbpml\" (UniqueName: \"kubernetes.io/projected/61679b19-c91b-4240-b22b-4b767b5407bc-kube-api-access-vbpml\") pod \"tuned-crfq6\" (UID: \"61679b19-c91b-4240-b22b-4b767b5407bc\") " pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.074258 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.074215 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4gdz\" (UniqueName: \"kubernetes.io/projected/feb31a59-2375-4790-a4cf-ed314aee2605-kube-api-access-w4gdz\") pod \"aws-ebs-csi-driver-node-rnhhq\" (UID: \"feb31a59-2375-4790-a4cf-ed314aee2605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.075203 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.075180 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxflf\" (UniqueName: \"kubernetes.io/projected/8829ddc0-02b1-483f-8009-73c4c83f6935-kube-api-access-rxflf\") pod \"node-resolver-b7zv7\" (UID: \"8829ddc0-02b1-483f-8009-73c4c83f6935\") " pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:10.154694 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.154640 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qkp44" Jul 01 17:39:10.164721 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.164690 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" Jul 01 17:39:10.174759 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.174729 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v4hs2" Jul 01 17:39:10.182986 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.182823 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:10.192274 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.192252 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:10.207407 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.207385 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" Jul 01 17:39:10.218457 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.218435 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crfq6" Jul 01 17:39:10.228857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.228835 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b7zv7" Jul 01 17:39:10.235020 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.234998 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tsmc7" Jul 01 17:39:10.554527 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.554433 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:10.554527 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.554505 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6hv\" (UniqueName: \"kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv\") pod \"network-check-target-wq6jk\" (UID: \"7cbfd800-dc00-43a9-9ece-aebf1e56c67c\") " pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:10.554783 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.554551 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:10.554783 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.554619 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:10.554783 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.554662 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:10.554783 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.554686 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:10.554783 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.554705 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:10.554783 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.554716 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret podName:35e8d50c-f601-4840-8909-8d462a7d6953 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:11.554694734 +0000 UTC m=+4.062346345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret") pod "global-pull-secret-syncer-nh728" (UID: "35e8d50c-f601-4840-8909-8d462a7d6953") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:10.554783 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.554718 2557 projected.go:196] Error preparing data for projected volume kube-api-access-6v6hv for pod openshift-network-diagnostics/network-check-target-wq6jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:10.554783 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.554742 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs podName:e9405216-0c3e-46c9-9d9d-d4904fccd18f nodeName:}" failed. No retries permitted until 2026-07-01 17:39:11.554724061 +0000 UTC m=+4.062375675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs") pod "network-metrics-daemon-qvjbt" (UID: "e9405216-0c3e-46c9-9d9d-d4904fccd18f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:10.554783 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:10.554762 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv podName:7cbfd800-dc00-43a9-9ece-aebf1e56c67c nodeName:}" failed. No retries permitted until 2026-07-01 17:39:11.554750714 +0000 UTC m=+4.062402301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6v6hv" (UniqueName: "kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv") pod "network-check-target-wq6jk" (UID: "7cbfd800-dc00-43a9-9ece-aebf1e56c67c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:10.907447 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.907396 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:34:10 +0000 UTC" deadline="2028-01-16 09:04:57.535778202 +0000 UTC" Jul 01 17:39:10.907447 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:10.907444 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13527h25m46.628336632s" Jul 01 17:39:11.050952 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:11.050742 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773871da_d67a_452f_8acc_b169f6dd8711.slice/crio-9327736cd009e909c45e8daa0f6f417925f5956e9df8ac4d68a7f6821491a5ec WatchSource:0}: Error finding container 9327736cd009e909c45e8daa0f6f417925f5956e9df8ac4d68a7f6821491a5ec: Status 404 returned error can't find the container with id 9327736cd009e909c45e8daa0f6f417925f5956e9df8ac4d68a7f6821491a5ec Jul 01 17:39:11.054128 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:11.054092 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61679b19_c91b_4240_b22b_4b767b5407bc.slice/crio-394c9b93e35949d0ba12f81fd9e00ec859c174401fe3d9cfed9e8a30f459b78c WatchSource:0}: Error finding container 394c9b93e35949d0ba12f81fd9e00ec859c174401fe3d9cfed9e8a30f459b78c: Status 404 returned error can't find the container with id 394c9b93e35949d0ba12f81fd9e00ec859c174401fe3d9cfed9e8a30f459b78c Jul 01 17:39:11.062713 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:11.062687 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f6c17c_cb22_47d2_8e1c_99c2fe73b0fc.slice/crio-11b3ffd6b0a6e87cbe56bcb0c03070421ef0a7932e443a06098327e34fd99186 WatchSource:0}: Error finding container 11b3ffd6b0a6e87cbe56bcb0c03070421ef0a7932e443a06098327e34fd99186: Status 404 returned error can't find the container with id 11b3ffd6b0a6e87cbe56bcb0c03070421ef0a7932e443a06098327e34fd99186 Jul 01 17:39:11.064040 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:11.064016 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb31a59_2375_4790_a4cf_ed314aee2605.slice/crio-66802ed2c2967e183263938af010ac1d8ffb7be5a540c0cf4c6786741eba9888 WatchSource:0}: Error finding container 66802ed2c2967e183263938af010ac1d8ffb7be5a540c0cf4c6786741eba9888: Status 404 returned error can't find the container with id 66802ed2c2967e183263938af010ac1d8ffb7be5a540c0cf4c6786741eba9888 Jul 01 17:39:11.064759 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:11.064502 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e0159e_4247_4c24_9783_f9cd8c368db9.slice/crio-a82ec41bc30606de9a6960bb1aef3e2adf2be667ed999d8bcc33ab06fe2421ae WatchSource:0}: Error finding container a82ec41bc30606de9a6960bb1aef3e2adf2be667ed999d8bcc33ab06fe2421ae: Status 404 returned error can't find the container with id a82ec41bc30606de9a6960bb1aef3e2adf2be667ed999d8bcc33ab06fe2421ae Jul 01 17:39:11.067747 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:11.066886 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5872131c_cc29_4fa7_8687_a9658d15532b.slice/crio-c8cfb50a7b90d9ec6669e369ad8f9a77ea0305114ca540694fb26162c0c1d7de WatchSource:0}: Error finding container c8cfb50a7b90d9ec6669e369ad8f9a77ea0305114ca540694fb26162c0c1d7de: Status 404 returned error can't find the container with id c8cfb50a7b90d9ec6669e369ad8f9a77ea0305114ca540694fb26162c0c1d7de Jul 01 17:39:11.074568 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:11.074540 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8829ddc0_02b1_483f_8009_73c4c83f6935.slice/crio-c962609463860ac7a8c1847341e92f18099486d03c518f66a0ba5c96a470c1ca WatchSource:0}: Error finding container c962609463860ac7a8c1847341e92f18099486d03c518f66a0ba5c96a470c1ca: Status 404 returned error can't find the container with id c962609463860ac7a8c1847341e92f18099486d03c518f66a0ba5c96a470c1ca Jul 01 17:39:11.077867 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:11.076923 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd36b5a_fe95_4e3e_916a_aba4f9fe2ec2.slice/crio-abb58639311af6cedb94ffd0791adbb8cb2eece7005c7777aa604e85056d408f WatchSource:0}: Error finding container abb58639311af6cedb94ffd0791adbb8cb2eece7005c7777aa604e85056d408f: Status 404 returned error can't find the container with id abb58639311af6cedb94ffd0791adbb8cb2eece7005c7777aa604e85056d408f Jul 01 17:39:11.563228 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.563149 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:11.563392 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.563282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:11.563470 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.563437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6hv\" (UniqueName: \"kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv\") pod \"network-check-target-wq6jk\" (UID: \"7cbfd800-dc00-43a9-9ece-aebf1e56c67c\") " pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:11.563957 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.563589 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:11.563957 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.563614 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:11.563957 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.563629 2557 projected.go:196] Error preparing data for projected volume kube-api-access-6v6hv for pod openshift-network-diagnostics/network-check-target-wq6jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:11.563957 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.563658 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:11.563957 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.563693 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv podName:7cbfd800-dc00-43a9-9ece-aebf1e56c67c nodeName:}" failed. No retries permitted until 2026-07-01 17:39:13.563672334 +0000 UTC m=+6.071323926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6v6hv" (UniqueName: "kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv") pod "network-check-target-wq6jk" (UID: "7cbfd800-dc00-43a9-9ece-aebf1e56c67c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:11.563957 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.563886 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs podName:e9405216-0c3e-46c9-9d9d-d4904fccd18f nodeName:}" failed. No retries permitted until 2026-07-01 17:39:13.563866349 +0000 UTC m=+6.071517950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs") pod "network-metrics-daemon-qvjbt" (UID: "e9405216-0c3e-46c9-9d9d-d4904fccd18f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:11.563957 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.563797 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:11.563957 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.563924 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret podName:35e8d50c-f601-4840-8909-8d462a7d6953 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:13.56391223 +0000 UTC m=+6.071563823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret") pod "global-pull-secret-syncer-nh728" (UID: "35e8d50c-f601-4840-8909-8d462a7d6953") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:11.910517 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.910448 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:34:10 +0000 UTC" deadline="2027-11-27 04:25:43.871628116 +0000 UTC" Jul 01 17:39:11.910517 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.910514 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12322h46m31.961117719s" Jul 01 17:39:11.911062 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.910606 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:11.911062 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.910736 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:11.911196 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.911169 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:11.911303 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.911283 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:11.911371 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.911352 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:11.911521 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:11.911419 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:11.928716 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.928684 2557 generic.go:356] "Generic (PLEG): container finished" podID="67b7fa50d98634df2a86c93306215d81" containerID="a10337cbb24bee09f766223013d744f45e94bcad50a895407ce9d0893c84ae62" exitCode=0 Jul 01 17:39:11.928858 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.928804 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" event={"ID":"67b7fa50d98634df2a86c93306215d81","Type":"ContainerDied","Data":"a10337cbb24bee09f766223013d744f45e94bcad50a895407ce9d0893c84ae62"} Jul 01 17:39:11.941914 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.941885 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal" event={"ID":"7a26dcbe7740a0418a5dbe53bf94c782","Type":"ContainerStarted","Data":"73f2fbbec41b568be7aee04a8ff8e22867ae4fc47957fa1d4fb3af4a85c1c5ec"} Jul 01 17:39:11.950511 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.950461 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tsmc7" event={"ID":"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b","Type":"ContainerStarted","Data":"93620b9f63600787c70a5ee581fcf4bbb20f2fb60cd59ad357101082cf6106c3"} Jul 01 17:39:11.953027 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.952996 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" event={"ID":"5872131c-cc29-4fa7-8687-a9658d15532b","Type":"ContainerStarted","Data":"c8cfb50a7b90d9ec6669e369ad8f9a77ea0305114ca540694fb26162c0c1d7de"} Jul 01 17:39:11.959740 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.959665 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qkp44" event={"ID":"61e0159e-4247-4c24-9783-f9cd8c368db9","Type":"ContainerStarted","Data":"a82ec41bc30606de9a6960bb1aef3e2adf2be667ed999d8bcc33ab06fe2421ae"} Jul 01 17:39:11.966634 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.966566 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-89.ec2.internal" podStartSLOduration=1.966548733 podStartE2EDuration="1.966548733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:11.96614274 +0000 UTC m=+4.473794352" watchObservedRunningTime="2026-07-01 17:39:11.966548733 +0000 UTC m=+4.474200346" Jul 01 17:39:11.984798 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.984772 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crfq6" event={"ID":"61679b19-c91b-4240-b22b-4b767b5407bc","Type":"ContainerStarted","Data":"394c9b93e35949d0ba12f81fd9e00ec859c174401fe3d9cfed9e8a30f459b78c"} Jul 01 17:39:11.990321 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.990295 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" event={"ID":"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2","Type":"ContainerStarted","Data":"abb58639311af6cedb94ffd0791adbb8cb2eece7005c7777aa604e85056d408f"} Jul 01 17:39:11.997540 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:11.997250 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b7zv7" event={"ID":"8829ddc0-02b1-483f-8009-73c4c83f6935","Type":"ContainerStarted","Data":"c962609463860ac7a8c1847341e92f18099486d03c518f66a0ba5c96a470c1ca"} Jul 01 17:39:12.006155 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:12.003332 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" event={"ID":"feb31a59-2375-4790-a4cf-ed314aee2605","Type":"ContainerStarted","Data":"66802ed2c2967e183263938af010ac1d8ffb7be5a540c0cf4c6786741eba9888"} Jul 01 17:39:12.008029 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:12.007869 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v4hs2" event={"ID":"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc","Type":"ContainerStarted","Data":"11b3ffd6b0a6e87cbe56bcb0c03070421ef0a7932e443a06098327e34fd99186"} Jul 01 17:39:12.011036 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:12.010906 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n77l4" event={"ID":"773871da-d67a-452f-8acc-b169f6dd8711","Type":"ContainerStarted","Data":"9327736cd009e909c45e8daa0f6f417925f5956e9df8ac4d68a7f6821491a5ec"} Jul 01 17:39:13.025775 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:13.025716 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" event={"ID":"67b7fa50d98634df2a86c93306215d81","Type":"ContainerStarted","Data":"417de381929155a802976d1a636b86d30992eb9061fb8b9c3bd145b10f6855ad"} Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:13.580526 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:13.580597 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:13.580647 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6hv\" (UniqueName: \"kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv\") pod \"network-check-target-wq6jk\" (UID: \"7cbfd800-dc00-43a9-9ece-aebf1e56c67c\") " pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.580818 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.580838 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.580852 2557 projected.go:196] Error preparing data for projected volume kube-api-access-6v6hv for pod openshift-network-diagnostics/network-check-target-wq6jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.580912 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv podName:7cbfd800-dc00-43a9-9ece-aebf1e56c67c nodeName:}" failed. No retries permitted until 2026-07-01 17:39:17.580892407 +0000 UTC m=+10.088544012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6v6hv" (UniqueName: "kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv") pod "network-check-target-wq6jk" (UID: "7cbfd800-dc00-43a9-9ece-aebf1e56c67c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.581317 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.581367 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs podName:e9405216-0c3e-46c9-9d9d-d4904fccd18f nodeName:}" failed. No retries permitted until 2026-07-01 17:39:17.581351709 +0000 UTC m=+10.089003300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs") pod "network-metrics-daemon-qvjbt" (UID: "e9405216-0c3e-46c9-9d9d-d4904fccd18f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.581421 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:13.581498 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.581458 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret podName:35e8d50c-f601-4840-8909-8d462a7d6953 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:17.581446578 +0000 UTC m=+10.089098198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret") pod "global-pull-secret-syncer-nh728" (UID: "35e8d50c-f601-4840-8909-8d462a7d6953") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:13.907276 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:13.907240 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:13.907453 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.907384 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:13.907776 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:13.907751 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:13.907901 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.907878 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:13.907976 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:13.907961 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:13.908098 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:13.908074 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:15.907715 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:15.907672 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:15.908198 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:15.907818 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:15.908820 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:15.908595 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:15.908820 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:15.908746 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:15.909067 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:15.909045 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:15.909156 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:15.909140 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:17.615906 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:17.615861 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:17.616396 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:17.615935 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6hv\" (UniqueName: \"kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv\") pod \"network-check-target-wq6jk\" (UID: \"7cbfd800-dc00-43a9-9ece-aebf1e56c67c\") " pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:17.616396 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:17.615991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:17.616396 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.616027 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:17.616396 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.616085 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:17.616396 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.616098 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:17.616396 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.616107 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret podName:35e8d50c-f601-4840-8909-8d462a7d6953 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:25.616087392 +0000 UTC m=+18.123739001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret") pod "global-pull-secret-syncer-nh728" (UID: "35e8d50c-f601-4840-8909-8d462a7d6953") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:17.616396 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.616112 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:17.616396 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.616126 2557 projected.go:196] Error preparing data for projected volume kube-api-access-6v6hv for pod openshift-network-diagnostics/network-check-target-wq6jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:17.616396 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.616151 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs podName:e9405216-0c3e-46c9-9d9d-d4904fccd18f nodeName:}" failed. No retries permitted until 2026-07-01 17:39:25.616134147 +0000 UTC m=+18.123785750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs") pod "network-metrics-daemon-qvjbt" (UID: "e9405216-0c3e-46c9-9d9d-d4904fccd18f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:17.616396 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.616173 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv podName:7cbfd800-dc00-43a9-9ece-aebf1e56c67c nodeName:}" failed. No retries permitted until 2026-07-01 17:39:25.616159801 +0000 UTC m=+18.123811388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6v6hv" (UniqueName: "kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv") pod "network-check-target-wq6jk" (UID: "7cbfd800-dc00-43a9-9ece-aebf1e56c67c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:17.907807 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:17.907712 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:17.907976 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.907837 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:17.907976 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:17.907885 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:17.908086 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.908022 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:17.908086 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:17.908069 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:17.908189 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:17.908137 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:19.907886 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:19.907855 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:19.908302 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:19.907851 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:19.908302 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:19.908008 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:19.908302 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:19.908045 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:19.908302 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:19.908115 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:19.908302 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:19.908180 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:21.907953 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:21.907914 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:21.909520 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:21.907930 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:21.909520 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:21.908086 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:21.909520 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:21.908117 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:21.909520 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:21.908247 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:21.909520 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:21.908333 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:23.907694 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:23.907637 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:23.908176 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:23.907638 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:23.908176 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:23.907778 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:23.908176 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:23.907791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:23.908176 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:23.907870 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:23.908176 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:23.907980 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:25.675093 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:25.675061 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:25.675550 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:25.675104 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6hv\" (UniqueName: \"kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv\") pod \"network-check-target-wq6jk\" (UID: \"7cbfd800-dc00-43a9-9ece-aebf1e56c67c\") " pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:25.675550 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:25.675141 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:25.675550 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.675240 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:25.675550 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.675244 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:25.675550 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.675265 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:25.675550 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.675287 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:25.675550 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.675298 2557 projected.go:196] Error preparing data for projected volume kube-api-access-6v6hv for pod openshift-network-diagnostics/network-check-target-wq6jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:25.675550 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.675307 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs podName:e9405216-0c3e-46c9-9d9d-d4904fccd18f nodeName:}" failed. No retries permitted until 2026-07-01 17:39:41.675289024 +0000 UTC m=+34.182940633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs") pod "network-metrics-daemon-qvjbt" (UID: "e9405216-0c3e-46c9-9d9d-d4904fccd18f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:25.675550 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.675323 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret podName:35e8d50c-f601-4840-8909-8d462a7d6953 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:41.675315485 +0000 UTC m=+34.182967071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret") pod "global-pull-secret-syncer-nh728" (UID: "35e8d50c-f601-4840-8909-8d462a7d6953") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:25.675550 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.675345 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv podName:7cbfd800-dc00-43a9-9ece-aebf1e56c67c nodeName:}" failed. No retries permitted until 2026-07-01 17:39:41.675327138 +0000 UTC m=+34.182978740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6v6hv" (UniqueName: "kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv") pod "network-check-target-wq6jk" (UID: "7cbfd800-dc00-43a9-9ece-aebf1e56c67c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:25.908044 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:25.907574 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:25.908044 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:25.907603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:25.908044 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:25.907715 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:25.908044 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.907725 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:25.908044 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.907805 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:25.908044 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:25.907864 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:27.908076 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:27.908024 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:27.908541 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:27.908120 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:27.908541 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:27.908166 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:27.908541 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:27.908162 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:27.908541 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:27.908251 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:27.908541 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:27.908361 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:29.907683 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:29.907634 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:29.908134 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:29.907777 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:29.908134 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:29.907843 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:29.908134 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:29.907858 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:29.908134 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:29.907935 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:29.908134 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:29.908016 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:31.072117 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:31.071302 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crfq6" event={"ID":"61679b19-c91b-4240-b22b-4b767b5407bc","Type":"ContainerStarted","Data":"a21adf4d4d106ed83ca94fe356d1340ae2eda04326033a35121ca0d0677af320"} Jul 01 17:39:31.077236 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:31.076986 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" event={"ID":"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2","Type":"ContainerStarted","Data":"f17f2c0c89f9624718087f45c457e14c0d1bb73d39bbe36bdfff1e4eea2ac195"} Jul 01 17:39:31.102615 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:31.102323 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-crfq6" podStartSLOduration=2.270985877 podStartE2EDuration="22.102308721s" totalImagesPullingTime="19.831322844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:31.101554076 +0000 UTC m=+23.609205684" watchObservedRunningTime="2026-07-01 17:39:31.102308721 +0000 UTC m=+23.609960328" Jul 01 17:39:31.102615 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:31.102456 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-89.ec2.internal" podStartSLOduration=21.102449344 podStartE2EDuration="21.102449344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:13.054970247 +0000 UTC m=+5.562621861" watchObservedRunningTime="2026-07-01 17:39:31.102449344 +0000 UTC m=+23.610100951" Jul 01 17:39:31.907419 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:31.907270 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:31.907580 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:31.907271 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:31.907580 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:31.907499 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:31.907725 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:31.907597 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:31.907725 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:31.907348 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:31.907807 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:31.907729 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:32.091691 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.091668 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4tzt_4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2/ovn-acl-logging/0.log" Jul 01 17:39:32.092293 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.091966 2557 generic.go:356] "Generic (PLEG): container finished" podID="4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2" containerID="00de8887498e3d01221723af6cdc371a015c835baaf2e3cbcb7f0a663dd8249d" exitCode=1 Jul 01 17:39:32.092293 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.092031 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" event={"ID":"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2","Type":"ContainerStarted","Data":"34acb4548b005adeafe84fd0b721c44108796a1356717907c2192d9499658c03"} Jul 01 17:39:32.092293 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.092095 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" event={"ID":"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2","Type":"ContainerStarted","Data":"e32bff0fdb659ae739f5fed6f48c33eb6a78a158c83beb49e938b8d1ef38ff1b"} Jul 01 17:39:32.092293 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.092126 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" event={"ID":"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2","Type":"ContainerStarted","Data":"f1e45dc2211a018e1074102dc6ab35c9df6e5141faee17ee5e2bf3b611a48495"} Jul 01 17:39:32.092293 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.092157 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" event={"ID":"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2","Type":"ContainerStarted","Data":"7789e74db8aef4d4d648d22df5800992575ca8e6888134bb732cf63adec3bcb8"} Jul 01 17:39:32.092293 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.092187 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" event={"ID":"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2","Type":"ContainerDied","Data":"00de8887498e3d01221723af6cdc371a015c835baaf2e3cbcb7f0a663dd8249d"} Jul 01 17:39:32.093311 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.093288 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b7zv7" event={"ID":"8829ddc0-02b1-483f-8009-73c4c83f6935","Type":"ContainerStarted","Data":"3a3bf15f2db0c46389d6093aead8a98b37cb3d98dbad3c4ef25dd03d9abf53dd"} Jul 01 17:39:32.094687 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.094669 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" event={"ID":"feb31a59-2375-4790-a4cf-ed314aee2605","Type":"ContainerStarted","Data":"d7e76c36fb229fea8409aa3c29485dca4bb5f9db6902b3e658616ea4917da01c"} Jul 01 17:39:32.095815 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.095798 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n77l4" event={"ID":"773871da-d67a-452f-8acc-b169f6dd8711","Type":"ContainerStarted","Data":"8f5612e09cab8ccb3eb8cc66e2099c81275248c0a9fdf58aa306e05e30b3aef2"} Jul 01 17:39:32.097216 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.097197 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tsmc7" event={"ID":"02fb1131-5a5f-4faf-8ab0-3d755acb8c2b","Type":"ContainerStarted","Data":"38df75b36a7c95df3937eacc4a2a86401b4bdf8cae4df5f54a0a19c3cbe93eba"} Jul 01 17:39:32.098448 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.098425 2557 generic.go:356] "Generic (PLEG): container finished" podID="5872131c-cc29-4fa7-8687-a9658d15532b" containerID="b575a4b72b9afe16ead8441a3e1a1acd710d2007f40f61b143a7dfc59410074e" exitCode=0 Jul 01 17:39:32.098527 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.098493 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" event={"ID":"5872131c-cc29-4fa7-8687-a9658d15532b","Type":"ContainerDied","Data":"b575a4b72b9afe16ead8441a3e1a1acd710d2007f40f61b143a7dfc59410074e"} Jul 01 17:39:32.100018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.099997 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qkp44" event={"ID":"61e0159e-4247-4c24-9783-f9cd8c368db9","Type":"ContainerStarted","Data":"5b2687c6872d04f1f5a3f3cf07afd763fdd8b4304442915b7f8c32c2c01babd1"} Jul 01 17:39:32.189039 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.188959 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b7zv7" podStartSLOduration=3.388103131 podStartE2EDuration="23.188945507s" totalImagesPullingTime="19.800842376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:32.128440506 +0000 UTC m=+24.636092113" watchObservedRunningTime="2026-07-01 17:39:32.188945507 +0000 UTC m=+24.696597114" Jul 01 17:39:32.261941 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.261902 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qkp44" podStartSLOduration=3.448150655 podStartE2EDuration="23.261889467s" totalImagesPullingTime="19.813738812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:32.189218649 +0000 UTC m=+24.696870257" watchObservedRunningTime="2026-07-01 17:39:32.261889467 +0000 UTC m=+24.769541075" Jul 01 17:39:32.346777 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.346739 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n77l4" podStartSLOduration=11.665097236 podStartE2EDuration="23.346720234s" totalImagesPullingTime="11.681622998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:32.301790328 +0000 UTC m=+24.809441934" watchObservedRunningTime="2026-07-01 17:39:32.346720234 +0000 UTC m=+24.854371836" Jul 01 17:39:32.346967 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:32.346948 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tsmc7" podStartSLOduration=3.494849967 podStartE2EDuration="23.346942906s" totalImagesPullingTime="19.852092939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:32.345457291 +0000 UTC m=+24.853108900" watchObservedRunningTime="2026-07-01 17:39:32.346942906 +0000 UTC m=+24.854594513" Jul 01 17:39:33.103867 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:33.103825 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v4hs2" event={"ID":"77f6c17c-cb22-47d2-8e1c-99c2fe73b0fc","Type":"ContainerStarted","Data":"255ce6250ac448f6cf13cbf0ae617e52dfc559674cc43ac81a4cbcc54aa6c991"} Jul 01 17:39:33.127925 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:33.127875 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v4hs2" podStartSLOduration=4.309734115 podStartE2EDuration="24.127860337s" totalImagesPullingTime="19.818126222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:33.127727956 +0000 UTC m=+25.635379564" watchObservedRunningTime="2026-07-01 17:39:33.127860337 +0000 UTC m=+25.635511945" Jul 01 17:39:33.347431 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:33.347397 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:33.348079 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:33.348051 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:33.907774 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:33.907740 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:33.907774 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:33.907760 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:33.907774 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:33.907776 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:33.908064 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:33.907862 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:33.908064 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:33.907936 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:33.908064 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:33.908005 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:34.096588 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:34.096434 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 17:39:34.109737 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:34.109714 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4tzt_4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2/ovn-acl-logging/0.log" Jul 01 17:39:34.110139 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:34.110113 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" event={"ID":"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2","Type":"ContainerStarted","Data":"622c2d24648d43ba3ac56dfc7a7617939b3086126c97eea54586a3ae7590d66a"} Jul 01 17:39:34.112266 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:34.112236 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" event={"ID":"feb31a59-2375-4790-a4cf-ed314aee2605","Type":"ContainerStarted","Data":"b28fdad3960e690fd8fd2c718903930e7dd9501150533b802b954a0f8e445859"} Jul 01 17:39:34.112699 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:34.112683 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:34.113122 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:34.113104 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n77l4" Jul 01 17:39:34.912385 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:34.912277 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T17:39:34.096586354Z","UUID":"49fcf071-456f-4aba-b47a-0a68d3d42cc6","Handler":null,"Name":"","Endpoint":""} Jul 01 17:39:34.913744 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:34.913725 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 17:39:34.913875 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:34.913766 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 17:39:35.907127 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:35.907093 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:35.907685 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:35.907132 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:35.907685 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:35.907102 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:35.907685 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:35.907207 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:35.907685 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:35.907262 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:35.907685 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:35.907347 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:37.120439 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.120266 2557 generic.go:356] "Generic (PLEG): container finished" podID="5872131c-cc29-4fa7-8687-a9658d15532b" containerID="36393740cec6aa51d309735ad8b3059f1fe67bde62f1271a346d577c7c6095af" exitCode=0 Jul 01 17:39:37.120992 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.120333 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" event={"ID":"5872131c-cc29-4fa7-8687-a9658d15532b","Type":"ContainerDied","Data":"36393740cec6aa51d309735ad8b3059f1fe67bde62f1271a346d577c7c6095af"} Jul 01 17:39:37.124190 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.124175 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4tzt_4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2/ovn-acl-logging/0.log" Jul 01 17:39:37.124559 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.124533 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" event={"ID":"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2","Type":"ContainerStarted","Data":"ebdabaf0ffa902ee26afb1f343febfeded51e1dbc626d2dc050a89527d645950"} Jul 01 17:39:37.124919 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.124899 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:37.125041 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.124956 2557 scope.go:117] "RemoveContainer" containerID="00de8887498e3d01221723af6cdc371a015c835baaf2e3cbcb7f0a663dd8249d" Jul 01 17:39:37.125041 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.124971 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:37.125041 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.125025 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:37.129419 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.129384 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" event={"ID":"feb31a59-2375-4790-a4cf-ed314aee2605","Type":"ContainerStarted","Data":"6e26a72635e99f4ff4b637de188de14a746b25f9080b89cc16417e9cc642a7ef"} Jul 01 17:39:37.142835 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.142817 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:37.142924 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.142910 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:39:37.211539 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.211495 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnhhq" podStartSLOduration=3.055301112 podStartE2EDuration="28.211480284s" totalImagesPullingTime="25.156179172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:37.211136638 +0000 UTC m=+29.718788247" watchObservedRunningTime="2026-07-01 17:39:37.211480284 +0000 UTC m=+29.719131911" Jul 01 17:39:37.908064 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.908037 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:37.908308 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.908074 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:37.908308 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:37.908122 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:37.908308 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:37.908174 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:37.908308 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:37.908219 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:37.908308 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:37.908304 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:38.137608 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:38.137579 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4tzt_4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2/ovn-acl-logging/0.log" Jul 01 17:39:38.138067 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:38.137993 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" event={"ID":"4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2","Type":"ContainerStarted","Data":"46bae412b9f8442f208c75d4ca9b2f4fae385e8a5a70a5883d25c5ac8a6e412e"} Jul 01 17:39:38.179175 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:38.179088 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" podStartSLOduration=9.358728724 podStartE2EDuration="29.179071698s" totalImagesPullingTime="19.820342974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:38.178378735 +0000 UTC m=+30.686030343" watchObservedRunningTime="2026-07-01 17:39:38.179071698 +0000 UTC m=+30.686723308" Jul 01 17:39:38.896925 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:38.896737 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qvjbt"] Jul 01 17:39:38.897085 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:38.897045 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:38.897154 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:38.897137 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:38.902677 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:38.902626 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nh728"] Jul 01 17:39:38.902803 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:38.902788 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:38.902931 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:38.902907 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:38.903140 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:38.903123 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wq6jk"] Jul 01 17:39:38.903212 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:38.903202 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:38.903299 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:38.903281 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:39.142744 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:39.142715 2557 generic.go:356] "Generic (PLEG): container finished" podID="5872131c-cc29-4fa7-8687-a9658d15532b" containerID="ab3db488ab515ab59b9b8e6002df2ad9e77af166f4836693273d36f05473f7a8" exitCode=0 Jul 01 17:39:39.143167 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:39.142790 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" event={"ID":"5872131c-cc29-4fa7-8687-a9658d15532b","Type":"ContainerDied","Data":"ab3db488ab515ab59b9b8e6002df2ad9e77af166f4836693273d36f05473f7a8"} Jul 01 17:39:40.907531 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:40.907501 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:40.907531 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:40.907515 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:40.908130 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:40.907591 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:40.908130 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:40.907672 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:40.908130 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:40.907770 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:40.908130 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:40.907858 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:41.149284 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:41.149253 2557 generic.go:356] "Generic (PLEG): container finished" podID="5872131c-cc29-4fa7-8687-a9658d15532b" containerID="b39a6d2acf0f6c66a022a54f71daf722a245bd9a6b84d378f13e672e2d99a39e" exitCode=0 Jul 01 17:39:41.149424 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:41.149306 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" event={"ID":"5872131c-cc29-4fa7-8687-a9658d15532b","Type":"ContainerDied","Data":"b39a6d2acf0f6c66a022a54f71daf722a245bd9a6b84d378f13e672e2d99a39e"} Jul 01 17:39:41.707566 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:41.707535 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:41.707775 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:41.707576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6hv\" (UniqueName: \"kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv\") pod \"network-check-target-wq6jk\" (UID: \"7cbfd800-dc00-43a9-9ece-aebf1e56c67c\") " pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:41.707775 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:41.707599 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:41.707775 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:41.707698 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:41.707775 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:41.707716 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:41.707775 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:41.707727 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:41.707775 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:41.707743 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:41.707775 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:41.707753 2557 projected.go:196] Error preparing data for projected volume kube-api-access-6v6hv for pod openshift-network-diagnostics/network-check-target-wq6jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:41.707775 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:41.707744 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs podName:e9405216-0c3e-46c9-9d9d-d4904fccd18f nodeName:}" failed. No retries permitted until 2026-07-01 17:40:13.707731142 +0000 UTC m=+66.215382727 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs") pod "network-metrics-daemon-qvjbt" (UID: "e9405216-0c3e-46c9-9d9d-d4904fccd18f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:41.708062 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:41.707797 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret podName:35e8d50c-f601-4840-8909-8d462a7d6953 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:13.707785621 +0000 UTC m=+66.215437207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret") pod "global-pull-secret-syncer-nh728" (UID: "35e8d50c-f601-4840-8909-8d462a7d6953") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:41.708062 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:41.707807 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv podName:7cbfd800-dc00-43a9-9ece-aebf1e56c67c nodeName:}" failed. No retries permitted until 2026-07-01 17:40:13.707801707 +0000 UTC m=+66.215453293 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6v6hv" (UniqueName: "kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv") pod "network-check-target-wq6jk" (UID: "7cbfd800-dc00-43a9-9ece-aebf1e56c67c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:42.907538 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:42.907504 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:42.908054 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:42.907504 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:42.908054 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:42.907612 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq6jk" podUID="7cbfd800-dc00-43a9-9ece-aebf1e56c67c" Jul 01 17:39:42.908054 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:42.907504 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:42.908054 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:42.907695 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nh728" podUID="35e8d50c-f601-4840-8909-8d462a7d6953" Jul 01 17:39:42.908054 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:42.907791 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvjbt" podUID="e9405216-0c3e-46c9-9d9d-d4904fccd18f" Jul 01 17:39:43.758205 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.758131 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-89.ec2.internal" event="NodeReady" Jul 01 17:39:43.758365 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.758274 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 17:39:43.812448 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.812416 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qqlpj"] Jul 01 17:39:43.816158 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.816137 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:43.818267 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.818248 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7dtjb"] Jul 01 17:39:43.821657 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.821613 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 17:39:43.823063 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.822005 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c4xn\"" Jul 01 17:39:43.823063 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.822095 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 17:39:43.823063 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.823014 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7dtjb" Jul 01 17:39:43.828237 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.828216 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 17:39:43.828318 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.828277 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qqlpj"] Jul 01 17:39:43.828403 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.828386 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b9ntr\"" Jul 01 17:39:43.829433 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.829258 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 17:39:43.829629 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.829599 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 17:39:43.835452 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.835435 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7dtjb"] Jul 01 17:39:43.923914 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.923884 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:43.923914 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.923917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-tmp-dir\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:43.924420 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.923941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-config-volume\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:43.924420 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.923971 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt67p\" (UniqueName: \"kubernetes.io/projected/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-kube-api-access-vt67p\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:43.924420 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.924014 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f661b214-e959-4c69-97f8-6d440c8d965f-cert\") pod \"ingress-canary-7dtjb\" (UID: \"f661b214-e959-4c69-97f8-6d440c8d965f\") " pod="openshift-ingress-canary/ingress-canary-7dtjb" Jul 01 17:39:43.924420 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:43.924030 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqd8g\" (UniqueName: \"kubernetes.io/projected/f661b214-e959-4c69-97f8-6d440c8d965f-kube-api-access-rqd8g\") pod \"ingress-canary-7dtjb\" (UID: \"f661b214-e959-4c69-97f8-6d440c8d965f\") " pod="openshift-ingress-canary/ingress-canary-7dtjb" Jul 01 17:39:44.024719 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.024628 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt67p\" (UniqueName: \"kubernetes.io/projected/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-kube-api-access-vt67p\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:44.024719 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.024716 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f661b214-e959-4c69-97f8-6d440c8d965f-cert\") pod \"ingress-canary-7dtjb\" (UID: \"f661b214-e959-4c69-97f8-6d440c8d965f\") " pod="openshift-ingress-canary/ingress-canary-7dtjb" Jul 01 17:39:44.024929 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.024742 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqd8g\" (UniqueName: \"kubernetes.io/projected/f661b214-e959-4c69-97f8-6d440c8d965f-kube-api-access-rqd8g\") pod \"ingress-canary-7dtjb\" (UID: \"f661b214-e959-4c69-97f8-6d440c8d965f\") " pod="openshift-ingress-canary/ingress-canary-7dtjb" Jul 01 17:39:44.024929 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.024814 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:44.024929 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.024836 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-tmp-dir\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:44.024929 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.024861 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-config-volume\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:44.025132 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:44.024930 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:44.025132 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:44.025007 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls podName:d789de5a-1fb9-4e71-86b6-3d6bb86cd5af nodeName:}" failed. No retries permitted until 2026-07-01 17:39:44.524985662 +0000 UTC m=+37.032637273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls") pod "dns-default-qqlpj" (UID: "d789de5a-1fb9-4e71-86b6-3d6bb86cd5af") : secret "dns-default-metrics-tls" not found Jul 01 17:39:44.025240 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.025217 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-tmp-dir\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:44.025462 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.025432 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-config-volume\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:44.029860 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.029835 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f661b214-e959-4c69-97f8-6d440c8d965f-cert\") pod \"ingress-canary-7dtjb\" (UID: \"f661b214-e959-4c69-97f8-6d440c8d965f\") " pod="openshift-ingress-canary/ingress-canary-7dtjb" Jul 01 17:39:44.036398 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.036372 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt67p\" (UniqueName: \"kubernetes.io/projected/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-kube-api-access-vt67p\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:44.036746 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.036724 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqd8g\" (UniqueName: \"kubernetes.io/projected/f661b214-e959-4c69-97f8-6d440c8d965f-kube-api-access-rqd8g\") pod \"ingress-canary-7dtjb\" (UID: \"f661b214-e959-4c69-97f8-6d440c8d965f\") " pod="openshift-ingress-canary/ingress-canary-7dtjb" Jul 01 17:39:44.135393 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.135353 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7dtjb" Jul 01 17:39:44.529429 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.529384 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:44.529621 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:44.529562 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:44.529720 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:44.529659 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls podName:d789de5a-1fb9-4e71-86b6-3d6bb86cd5af nodeName:}" failed. No retries permitted until 2026-07-01 17:39:45.529623716 +0000 UTC m=+38.037275301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls") pod "dns-default-qqlpj" (UID: "d789de5a-1fb9-4e71-86b6-3d6bb86cd5af") : secret "dns-default-metrics-tls" not found Jul 01 17:39:44.907287 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.907252 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:39:44.907449 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.907252 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:39:44.907596 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.907264 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:39:44.910900 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.910878 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 17:39:44.911028 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.910935 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 17:39:44.912314 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.912294 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 17:39:44.912314 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.912303 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qsp7k\"" Jul 01 17:39:44.912459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.912345 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-47mbs\"" Jul 01 17:39:44.912459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:44.912303 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 17:39:45.483843 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:45.483707 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7dtjb"] Jul 01 17:39:45.486336 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:39:45.486297 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf661b214_e959_4c69_97f8_6d440c8d965f.slice/crio-edc49f08a5173209fe0f4baf37db7f0a49138b6cfa77a30bd36efa4d31aa23b2 WatchSource:0}: Error finding container edc49f08a5173209fe0f4baf37db7f0a49138b6cfa77a30bd36efa4d31aa23b2: Status 404 returned error can't find the container with id edc49f08a5173209fe0f4baf37db7f0a49138b6cfa77a30bd36efa4d31aa23b2 Jul 01 17:39:45.536425 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:45.536402 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:45.536570 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:45.536554 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:45.536625 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:45.536615 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls podName:d789de5a-1fb9-4e71-86b6-3d6bb86cd5af nodeName:}" failed. No retries permitted until 2026-07-01 17:39:47.536597182 +0000 UTC m=+40.044248771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls") pod "dns-default-qqlpj" (UID: "d789de5a-1fb9-4e71-86b6-3d6bb86cd5af") : secret "dns-default-metrics-tls" not found Jul 01 17:39:46.163355 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:46.163327 2557 generic.go:356] "Generic (PLEG): container finished" podID="5872131c-cc29-4fa7-8687-a9658d15532b" containerID="0db2233d12fdf6fd5b8369cfec9831c32a701de2c1cfdbebd22d3cf1b56ce1fb" exitCode=0 Jul 01 17:39:46.163521 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:46.163417 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" event={"ID":"5872131c-cc29-4fa7-8687-a9658d15532b","Type":"ContainerDied","Data":"0db2233d12fdf6fd5b8369cfec9831c32a701de2c1cfdbebd22d3cf1b56ce1fb"} Jul 01 17:39:46.164588 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:46.164555 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7dtjb" event={"ID":"f661b214-e959-4c69-97f8-6d440c8d965f","Type":"ContainerStarted","Data":"edc49f08a5173209fe0f4baf37db7f0a49138b6cfa77a30bd36efa4d31aa23b2"} Jul 01 17:39:47.169604 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:47.169567 2557 generic.go:356] "Generic (PLEG): container finished" podID="5872131c-cc29-4fa7-8687-a9658d15532b" containerID="5462bfa169e7d37672b2c831aa32ccdae0b0283e55f83caccbd1b73c1353acb8" exitCode=0 Jul 01 17:39:47.170061 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:47.169660 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" event={"ID":"5872131c-cc29-4fa7-8687-a9658d15532b","Type":"ContainerDied","Data":"5462bfa169e7d37672b2c831aa32ccdae0b0283e55f83caccbd1b73c1353acb8"} Jul 01 17:39:47.552116 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:47.551831 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:47.552266 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:47.551995 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:47.552266 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:47.552193 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls podName:d789de5a-1fb9-4e71-86b6-3d6bb86cd5af nodeName:}" failed. No retries permitted until 2026-07-01 17:39:51.552172106 +0000 UTC m=+44.059823696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls") pod "dns-default-qqlpj" (UID: "d789de5a-1fb9-4e71-86b6-3d6bb86cd5af") : secret "dns-default-metrics-tls" not found Jul 01 17:39:48.175855 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:48.175818 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" event={"ID":"5872131c-cc29-4fa7-8687-a9658d15532b","Type":"ContainerStarted","Data":"5fe4db2246ff25d1cd880931b283de3d8e9b003a2de1bbabf9166049c7705e8b"} Jul 01 17:39:48.212529 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:48.212480 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tzwq5" podStartSLOduration=8.247590765 podStartE2EDuration="39.212463392s" totalImagesPullingTime="30.964872627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:48.208333484 +0000 UTC m=+40.715985094" watchObservedRunningTime="2026-07-01 17:39:48.212463392 +0000 UTC m=+40.720115000" Jul 01 17:39:50.181317 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:50.181281 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7dtjb" event={"ID":"f661b214-e959-4c69-97f8-6d440c8d965f","Type":"ContainerStarted","Data":"0891572749f6fa07dda3fd319cddbf88a08f7acf439466d4a0e0bf5d22463c9b"} Jul 01 17:39:50.199029 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:50.198980 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7dtjb" podStartSLOduration=3.205482098 podStartE2EDuration="7.198959623s" totalImagesPullingTime="3.993477525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:50.198400015 +0000 UTC m=+42.706051623" watchObservedRunningTime="2026-07-01 17:39:50.198959623 +0000 UTC m=+42.706611232" Jul 01 17:39:51.582941 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:51.582908 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:51.583287 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:51.583046 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:51.583287 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:51.583104 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls podName:d789de5a-1fb9-4e71-86b6-3d6bb86cd5af nodeName:}" failed. No retries permitted until 2026-07-01 17:39:59.583089021 +0000 UTC m=+52.090740606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls") pod "dns-default-qqlpj" (UID: "d789de5a-1fb9-4e71-86b6-3d6bb86cd5af") : secret "dns-default-metrics-tls" not found Jul 01 17:39:58.751560 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.751533 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2"] Jul 01 17:39:58.769328 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.769304 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:39:58.775590 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.775570 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 17:39:58.775707 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.775585 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 17:39:58.777185 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.777168 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 17:39:58.778680 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.778667 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s7drq\"" Jul 01 17:39:58.778747 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.778704 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 17:39:58.796554 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.796531 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2"] Jul 01 17:39:58.834851 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.834829 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b2384345-9f55-49e3-9dae-21b506857126-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:39:58.834952 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.834853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:39:58.834952 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.834884 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwzrp\" (UniqueName: \"kubernetes.io/projected/b2384345-9f55-49e3-9dae-21b506857126-kube-api-access-dwzrp\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:39:58.935382 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.935357 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwzrp\" (UniqueName: \"kubernetes.io/projected/b2384345-9f55-49e3-9dae-21b506857126-kube-api-access-dwzrp\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:39:58.935480 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.935426 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b2384345-9f55-49e3-9dae-21b506857126-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:39:58.935480 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.935462 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:39:58.935549 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:58.935539 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:39:58.935618 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:58.935606 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls podName:b2384345-9f55-49e3-9dae-21b506857126 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:59.435588809 +0000 UTC m=+51.943240396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-gxjb2" (UID: "b2384345-9f55-49e3-9dae-21b506857126") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:39:58.936119 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.936100 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b2384345-9f55-49e3-9dae-21b506857126-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:39:58.959021 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:58.958997 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwzrp\" (UniqueName: \"kubernetes.io/projected/b2384345-9f55-49e3-9dae-21b506857126-kube-api-access-dwzrp\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:39:59.439354 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:59.439324 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:39:59.439560 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:59.439496 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:39:59.439634 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:59.439586 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls podName:b2384345-9f55-49e3-9dae-21b506857126 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:00.439568015 +0000 UTC m=+52.947219616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-gxjb2" (UID: "b2384345-9f55-49e3-9dae-21b506857126") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:39:59.640733 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:39:59.640694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:39:59.640915 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:59.640809 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:59.640915 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:39:59.640862 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls podName:d789de5a-1fb9-4e71-86b6-3d6bb86cd5af nodeName:}" failed. No retries permitted until 2026-07-01 17:40:15.640850107 +0000 UTC m=+68.148501692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls") pod "dns-default-qqlpj" (UID: "d789de5a-1fb9-4e71-86b6-3d6bb86cd5af") : secret "dns-default-metrics-tls" not found Jul 01 17:40:00.445978 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:00.445936 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:40:00.446347 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:00.446085 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:40:00.446347 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:00.446159 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls podName:b2384345-9f55-49e3-9dae-21b506857126 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:02.44614511 +0000 UTC m=+54.953796698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-gxjb2" (UID: "b2384345-9f55-49e3-9dae-21b506857126") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:40:02.460570 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:02.460533 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:40:02.461026 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:02.460704 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:40:02.461026 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:02.460771 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls podName:b2384345-9f55-49e3-9dae-21b506857126 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:06.460756802 +0000 UTC m=+58.968408388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-gxjb2" (UID: "b2384345-9f55-49e3-9dae-21b506857126") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:40:04.675198 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.675162 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d79pv"] Jul 01 17:40:04.677369 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.677353 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.681354 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.681329 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 17:40:04.681804 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.681788 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 17:40:04.682163 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.682136 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 17:40:04.683197 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.683180 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 17:40:04.683317 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.683293 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sc8wz\"" Jul 01 17:40:04.691996 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.691968 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d79pv"] Jul 01 17:40:04.775789 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.775749 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-data-volume\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.775968 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.775808 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-crio-socket\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.775968 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.775826 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.775968 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.775865 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.775968 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.775927 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ccgk\" (UniqueName: \"kubernetes.io/projected/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-api-access-8ccgk\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.877020 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.876983 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-data-volume\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.877213 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.877049 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-crio-socket\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.877213 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.877073 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.877213 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.877099 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.877213 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.877171 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ccgk\" (UniqueName: \"kubernetes.io/projected/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-api-access-8ccgk\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.877213 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.877189 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-crio-socket\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.877456 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:04.877245 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:04.877456 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:04.877319 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:05.377298069 +0000 UTC m=+57.884949656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:04.877456 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:04.877248 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:40:04.877456 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.877384 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-data-volume\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:04.877456 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:04.877399 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:05.377386185 +0000 UTC m=+57.885037809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : configmap "kube-rbac-proxy" not found Jul 01 17:40:04.889556 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:04.889520 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ccgk\" (UniqueName: \"kubernetes.io/projected/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-api-access-8ccgk\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:05.380730 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:05.380699 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:05.380730 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:05.380734 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:05.380966 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:05.380822 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:40:05.380966 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:05.380862 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:05.380966 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:05.380876 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:06.380862308 +0000 UTC m=+58.888513894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : configmap "kube-rbac-proxy" not found Jul 01 17:40:05.380966 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:05.380918 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:06.380903499 +0000 UTC m=+58.888555105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:06.389887 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:06.389846 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:06.389887 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:06.389890 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:06.390335 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:06.389998 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:06.390335 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:06.390018 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:40:06.390335 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:06.390061 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:08.390047873 +0000 UTC m=+60.897699463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:06.390335 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:06.390081 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:08.390066713 +0000 UTC m=+60.897718298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : configmap "kube-rbac-proxy" not found Jul 01 17:40:06.436307 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:06.436281 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b7zv7_8829ddc0-02b1-483f-8009-73c4c83f6935/dns-node-resolver/0.log" Jul 01 17:40:06.490436 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:06.490412 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:40:06.490553 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:06.490544 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:40:06.490604 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:06.490597 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls podName:b2384345-9f55-49e3-9dae-21b506857126 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:14.490583779 +0000 UTC m=+66.998235365 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-gxjb2" (UID: "b2384345-9f55-49e3-9dae-21b506857126") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:40:07.437971 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:07.437947 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qkp44_61e0159e-4247-4c24-9783-f9cd8c368db9/node-ca/0.log" Jul 01 17:40:08.036035 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.036008 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7dtjb_f661b214-e959-4c69-97f8-6d440c8d965f/serve-healthcheck-canary/0.log" Jul 01 17:40:08.407269 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.407235 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:08.407424 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.407275 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:08.407424 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:08.407381 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:40:08.407424 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:08.407390 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:08.407525 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:08.407435 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:12.407421789 +0000 UTC m=+64.915073375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : configmap "kube-rbac-proxy" not found Jul 01 17:40:08.407525 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:08.407448 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:12.407442455 +0000 UTC m=+64.915094041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:08.637828 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.637797 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m"] Jul 01 17:40:08.665328 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.665270 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m"] Jul 01 17:40:08.665428 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.665353 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:08.668926 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.668904 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:40:08.668926 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.668926 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 17:40:08.669091 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.668926 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 17:40:08.669091 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.668983 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 17:40:08.670363 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.670343 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4cxkb\"" Jul 01 17:40:08.710570 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.710544 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/343d9614-f190-4f47-9195-92c320541bd0-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-2947m\" (UID: \"343d9614-f190-4f47-9195-92c320541bd0\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:08.710715 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.710593 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/343d9614-f190-4f47-9195-92c320541bd0-config\") pod \"service-ca-operator-5d7b7dc95c-2947m\" (UID: \"343d9614-f190-4f47-9195-92c320541bd0\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:08.710715 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.710622 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbdwf\" (UniqueName: \"kubernetes.io/projected/343d9614-f190-4f47-9195-92c320541bd0-kube-api-access-rbdwf\") pod \"service-ca-operator-5d7b7dc95c-2947m\" (UID: \"343d9614-f190-4f47-9195-92c320541bd0\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:08.739821 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.739796 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx"] Jul 01 17:40:08.756477 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.756455 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx"] Jul 01 17:40:08.756586 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.756554 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx" Jul 01 17:40:08.759531 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.759488 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:40:08.759531 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.759491 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 17:40:08.759810 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.759795 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g8kld\"" Jul 01 17:40:08.810941 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.810914 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm5gg\" (UniqueName: \"kubernetes.io/projected/bcce152d-7b21-42cc-8945-c8cf864d6f61-kube-api-access-bm5gg\") pod \"volume-data-source-validator-69d9f679db-rn5zx\" (UID: \"bcce152d-7b21-42cc-8945-c8cf864d6f61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx" Jul 01 17:40:08.811032 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.810961 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/343d9614-f190-4f47-9195-92c320541bd0-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-2947m\" (UID: \"343d9614-f190-4f47-9195-92c320541bd0\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:08.811032 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.811005 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/343d9614-f190-4f47-9195-92c320541bd0-config\") pod \"service-ca-operator-5d7b7dc95c-2947m\" (UID: \"343d9614-f190-4f47-9195-92c320541bd0\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:08.811149 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.811032 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbdwf\" (UniqueName: \"kubernetes.io/projected/343d9614-f190-4f47-9195-92c320541bd0-kube-api-access-rbdwf\") pod \"service-ca-operator-5d7b7dc95c-2947m\" (UID: \"343d9614-f190-4f47-9195-92c320541bd0\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:08.811525 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.811505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/343d9614-f190-4f47-9195-92c320541bd0-config\") pod \"service-ca-operator-5d7b7dc95c-2947m\" (UID: \"343d9614-f190-4f47-9195-92c320541bd0\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:08.813285 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.813266 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/343d9614-f190-4f47-9195-92c320541bd0-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-2947m\" (UID: \"343d9614-f190-4f47-9195-92c320541bd0\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:08.820498 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.820479 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbdwf\" (UniqueName: \"kubernetes.io/projected/343d9614-f190-4f47-9195-92c320541bd0-kube-api-access-rbdwf\") pod \"service-ca-operator-5d7b7dc95c-2947m\" (UID: \"343d9614-f190-4f47-9195-92c320541bd0\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:08.843872 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.843850 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx"] Jul 01 17:40:08.864501 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.864483 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9"] Jul 01 17:40:08.864624 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.864609 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:08.868066 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.868041 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 17:40:08.869605 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.868326 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 17:40:08.869605 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.868421 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:40:08.869605 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.868670 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 17:40:08.869605 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.869256 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-szrhr\"" Jul 01 17:40:08.880481 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.880462 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx"] Jul 01 17:40:08.880562 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.880493 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9"] Jul 01 17:40:08.880600 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.880573 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:08.883127 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.883107 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-brxfs\"" Jul 01 17:40:08.883209 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.883152 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:40:08.883209 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.883107 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 17:40:08.883290 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.883115 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 17:40:08.911773 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.911749 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm5gg\" (UniqueName: \"kubernetes.io/projected/bcce152d-7b21-42cc-8945-c8cf864d6f61-kube-api-access-bm5gg\") pod \"volume-data-source-validator-69d9f679db-rn5zx\" (UID: \"bcce152d-7b21-42cc-8945-c8cf864d6f61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx" Jul 01 17:40:08.911864 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.911779 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:08.911864 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.911797 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac15f280-6a24-44fb-b6a3-83487bcc1319-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-9xvkx\" (UID: \"ac15f280-6a24-44fb-b6a3-83487bcc1319\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:08.911961 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.911875 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac15f280-6a24-44fb-b6a3-83487bcc1319-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-9xvkx\" (UID: \"ac15f280-6a24-44fb-b6a3-83487bcc1319\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:08.911961 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.911927 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtdqp\" (UniqueName: \"kubernetes.io/projected/ac15f280-6a24-44fb-b6a3-83487bcc1319-kube-api-access-dtdqp\") pod \"kube-storage-version-migrator-operator-79964ff6f9-9xvkx\" (UID: \"ac15f280-6a24-44fb-b6a3-83487bcc1319\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:08.912036 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.911990 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5wt2\" (UniqueName: \"kubernetes.io/projected/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-kube-api-access-z5wt2\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:08.920774 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.920723 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm5gg\" (UniqueName: \"kubernetes.io/projected/bcce152d-7b21-42cc-8945-c8cf864d6f61-kube-api-access-bm5gg\") pod \"volume-data-source-validator-69d9f679db-rn5zx\" (UID: \"bcce152d-7b21-42cc-8945-c8cf864d6f61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx" Jul 01 17:40:08.973831 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:08.973802 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" Jul 01 17:40:09.012602 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.012575 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5wt2\" (UniqueName: \"kubernetes.io/projected/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-kube-api-access-z5wt2\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:09.012717 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.012703 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:09.012762 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.012729 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac15f280-6a24-44fb-b6a3-83487bcc1319-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-9xvkx\" (UID: \"ac15f280-6a24-44fb-b6a3-83487bcc1319\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:09.012859 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:09.012839 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 17:40:09.012974 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.012882 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac15f280-6a24-44fb-b6a3-83487bcc1319-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-9xvkx\" (UID: \"ac15f280-6a24-44fb-b6a3-83487bcc1319\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:09.012974 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:09.012919 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls podName:ac5119dc-b7bc-4f92-8536-c33eea6df5b4 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:09.512885895 +0000 UTC m=+62.020537497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-pgtd9" (UID: "ac5119dc-b7bc-4f92-8536-c33eea6df5b4") : secret "samples-operator-tls" not found Jul 01 17:40:09.013094 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.012973 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtdqp\" (UniqueName: \"kubernetes.io/projected/ac15f280-6a24-44fb-b6a3-83487bcc1319-kube-api-access-dtdqp\") pod \"kube-storage-version-migrator-operator-79964ff6f9-9xvkx\" (UID: \"ac15f280-6a24-44fb-b6a3-83487bcc1319\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:09.013422 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.013401 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac15f280-6a24-44fb-b6a3-83487bcc1319-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-9xvkx\" (UID: \"ac15f280-6a24-44fb-b6a3-83487bcc1319\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:09.015164 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.015136 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac15f280-6a24-44fb-b6a3-83487bcc1319-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-9xvkx\" (UID: \"ac15f280-6a24-44fb-b6a3-83487bcc1319\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:09.021955 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.021934 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5wt2\" (UniqueName: \"kubernetes.io/projected/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-kube-api-access-z5wt2\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:09.022527 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.022508 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtdqp\" (UniqueName: \"kubernetes.io/projected/ac15f280-6a24-44fb-b6a3-83487bcc1319-kube-api-access-dtdqp\") pod \"kube-storage-version-migrator-operator-79964ff6f9-9xvkx\" (UID: \"ac15f280-6a24-44fb-b6a3-83487bcc1319\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:09.065599 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.065570 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx" Jul 01 17:40:09.117147 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.117126 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m"] Jul 01 17:40:09.119495 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:09.119473 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod343d9614_f190_4f47_9195_92c320541bd0.slice/crio-58a064fb0fbec14a8f295aa76908b54aa25df756090c0231af99c7feb7c199e7 WatchSource:0}: Error finding container 58a064fb0fbec14a8f295aa76908b54aa25df756090c0231af99c7feb7c199e7: Status 404 returned error can't find the container with id 58a064fb0fbec14a8f295aa76908b54aa25df756090c0231af99c7feb7c199e7 Jul 01 17:40:09.159369 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.159348 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4tzt" Jul 01 17:40:09.176032 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.176004 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" Jul 01 17:40:09.221825 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.221725 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx"] Jul 01 17:40:09.224061 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:09.224036 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcce152d_7b21_42cc_8945_c8cf864d6f61.slice/crio-63f3ef7d49106d538d190037669b7da4690747d724b340dfed5ab3a61f8cb32b WatchSource:0}: Error finding container 63f3ef7d49106d538d190037669b7da4690747d724b340dfed5ab3a61f8cb32b: Status 404 returned error can't find the container with id 63f3ef7d49106d538d190037669b7da4690747d724b340dfed5ab3a61f8cb32b Jul 01 17:40:09.226947 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.226923 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" event={"ID":"343d9614-f190-4f47-9195-92c320541bd0","Type":"ContainerStarted","Data":"58a064fb0fbec14a8f295aa76908b54aa25df756090c0231af99c7feb7c199e7"} Jul 01 17:40:09.328769 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.328544 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx"] Jul 01 17:40:09.331186 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:09.331160 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac15f280_6a24_44fb_b6a3_83487bcc1319.slice/crio-0e315f4d63021047cdb5c65445322bc1a2203ab8e537a7801d60d33963776484 WatchSource:0}: Error finding container 0e315f4d63021047cdb5c65445322bc1a2203ab8e537a7801d60d33963776484: Status 404 returned error can't find the container with id 0e315f4d63021047cdb5c65445322bc1a2203ab8e537a7801d60d33963776484 Jul 01 17:40:09.518375 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:09.518300 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:09.518517 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:09.518444 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 17:40:09.518517 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:09.518504 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls podName:ac5119dc-b7bc-4f92-8536-c33eea6df5b4 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:10.518487491 +0000 UTC m=+63.026139105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-pgtd9" (UID: "ac5119dc-b7bc-4f92-8536-c33eea6df5b4") : secret "samples-operator-tls" not found Jul 01 17:40:10.230980 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:10.230937 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" event={"ID":"ac15f280-6a24-44fb-b6a3-83487bcc1319","Type":"ContainerStarted","Data":"0e315f4d63021047cdb5c65445322bc1a2203ab8e537a7801d60d33963776484"} Jul 01 17:40:10.232229 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:10.232202 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx" event={"ID":"bcce152d-7b21-42cc-8945-c8cf864d6f61","Type":"ContainerStarted","Data":"63f3ef7d49106d538d190037669b7da4690747d724b340dfed5ab3a61f8cb32b"} Jul 01 17:40:10.527427 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:10.527330 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:10.527595 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:10.527523 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 17:40:10.527688 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:10.527605 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls podName:ac5119dc-b7bc-4f92-8536-c33eea6df5b4 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:12.5275849 +0000 UTC m=+65.035236494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-pgtd9" (UID: "ac5119dc-b7bc-4f92-8536-c33eea6df5b4") : secret "samples-operator-tls" not found Jul 01 17:40:12.242073 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:12.242034 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" event={"ID":"ac15f280-6a24-44fb-b6a3-83487bcc1319","Type":"ContainerStarted","Data":"7f63a91065dbe35861f67d7b5e8fdb365837b069a7a24d33ce3c57aa6a197a68"} Jul 01 17:40:12.243500 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:12.243473 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" event={"ID":"343d9614-f190-4f47-9195-92c320541bd0","Type":"ContainerStarted","Data":"2e5cef1af480ebfd1e46010171d086e8330c3232758eb16d39cb81078dbebe65"} Jul 01 17:40:12.260893 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:12.260848 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" podStartSLOduration=1.556385385 podStartE2EDuration="4.260831164s" totalImagesPullingTime="2.704445779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:12.258627484 +0000 UTC m=+64.766279093" watchObservedRunningTime="2026-07-01 17:40:12.260831164 +0000 UTC m=+64.768482752" Jul 01 17:40:12.277827 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:12.277782 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" podStartSLOduration=1.356001697 podStartE2EDuration="4.277767966s" totalImagesPullingTime="2.921766269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:12.274331248 +0000 UTC m=+64.781982857" watchObservedRunningTime="2026-07-01 17:40:12.277767966 +0000 UTC m=+64.785419574" Jul 01 17:40:12.444217 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:12.444175 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:12.444570 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:12.444257 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:12.444570 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:12.444332 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:12.444570 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:12.444399 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:40:12.444570 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:12.444435 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:20.444412768 +0000 UTC m=+72.952064381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:12.444570 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:12.444456 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:20.444443183 +0000 UTC m=+72.952094769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : configmap "kube-rbac-proxy" not found Jul 01 17:40:12.545543 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:12.545501 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:12.545708 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:12.545664 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 17:40:12.545751 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:12.545730 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls podName:ac5119dc-b7bc-4f92-8536-c33eea6df5b4 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:16.545714061 +0000 UTC m=+69.053365650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-pgtd9" (UID: "ac5119dc-b7bc-4f92-8536-c33eea6df5b4") : secret "samples-operator-tls" not found Jul 01 17:40:13.755807 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:13.755728 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:40:13.755807 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:13.755795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6hv\" (UniqueName: \"kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv\") pod \"network-check-target-wq6jk\" (UID: \"7cbfd800-dc00-43a9-9ece-aebf1e56c67c\") " pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:40:13.756195 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:13.755828 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:40:13.760781 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:13.760759 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 17:40:13.760835 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:13.760764 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 17:40:13.761330 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:13.761316 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 17:40:13.766085 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:13.766072 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 17:40:13.766171 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:13.766162 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs podName:e9405216-0c3e-46c9-9d9d-d4904fccd18f nodeName:}" failed. No retries permitted until 2026-07-01 17:41:17.766145552 +0000 UTC m=+130.273797140 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs") pod "network-metrics-daemon-qvjbt" (UID: "e9405216-0c3e-46c9-9d9d-d4904fccd18f") : secret "metrics-daemon-secret" not found Jul 01 17:40:13.768302 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:13.768278 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e8d50c-f601-4840-8909-8d462a7d6953-original-pull-secret\") pod \"global-pull-secret-syncer-nh728\" (UID: \"35e8d50c-f601-4840-8909-8d462a7d6953\") " pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:40:13.771206 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:13.771191 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 17:40:13.778549 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:13.778524 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v6hv\" (UniqueName: \"kubernetes.io/projected/7cbfd800-dc00-43a9-9ece-aebf1e56c67c-kube-api-access-6v6hv\") pod \"network-check-target-wq6jk\" (UID: \"7cbfd800-dc00-43a9-9ece-aebf1e56c67c\") " pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:40:14.021064 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:14.020994 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qsp7k\"" Jul 01 17:40:14.029238 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:14.029214 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:40:14.030379 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:14.030366 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nh728" Jul 01 17:40:14.180050 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:14.180030 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nh728"] Jul 01 17:40:14.182488 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:14.182463 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e8d50c_f601_4840_8909_8d462a7d6953.slice/crio-afb122b374f27a2f27d1959bcfd59a1c8965cca048e918b6b3ba487947c7567e WatchSource:0}: Error finding container afb122b374f27a2f27d1959bcfd59a1c8965cca048e918b6b3ba487947c7567e: Status 404 returned error can't find the container with id afb122b374f27a2f27d1959bcfd59a1c8965cca048e918b6b3ba487947c7567e Jul 01 17:40:14.188480 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:14.188458 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wq6jk"] Jul 01 17:40:14.189775 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:14.189750 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cbfd800_dc00_43a9_9ece_aebf1e56c67c.slice/crio-1d85b46a4a714c8299909979a33329be4764224049fb45079b676cdb1d5352a7 WatchSource:0}: Error finding container 1d85b46a4a714c8299909979a33329be4764224049fb45079b676cdb1d5352a7: Status 404 returned error can't find the container with id 1d85b46a4a714c8299909979a33329be4764224049fb45079b676cdb1d5352a7 Jul 01 17:40:14.249961 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:14.249928 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx" event={"ID":"bcce152d-7b21-42cc-8945-c8cf864d6f61","Type":"ContainerStarted","Data":"a98e11ea37b58dbaa14165bb4117417564386d53fdca33a58a3f8fccc7971184"} Jul 01 17:40:14.251098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:14.251076 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wq6jk" event={"ID":"7cbfd800-dc00-43a9-9ece-aebf1e56c67c","Type":"ContainerStarted","Data":"1d85b46a4a714c8299909979a33329be4764224049fb45079b676cdb1d5352a7"} Jul 01 17:40:14.252137 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:14.252119 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nh728" event={"ID":"35e8d50c-f601-4840-8909-8d462a7d6953","Type":"ContainerStarted","Data":"afb122b374f27a2f27d1959bcfd59a1c8965cca048e918b6b3ba487947c7567e"} Jul 01 17:40:14.272209 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:14.272140 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-rn5zx" podStartSLOduration=2.097783337 podStartE2EDuration="6.272127958s" totalImagesPullingTime="4.174344621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:14.271158264 +0000 UTC m=+66.778809872" watchObservedRunningTime="2026-07-01 17:40:14.272127958 +0000 UTC m=+66.779779565" Jul 01 17:40:14.561635 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:14.561560 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:40:14.561781 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:14.561728 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:40:14.561819 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:14.561790 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls podName:b2384345-9f55-49e3-9dae-21b506857126 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:30.561775064 +0000 UTC m=+83.069426671 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-gxjb2" (UID: "b2384345-9f55-49e3-9dae-21b506857126") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:40:15.670397 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:15.670362 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:40:15.670764 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:15.670489 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:40:15.670764 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:15.670545 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls podName:d789de5a-1fb9-4e71-86b6-3d6bb86cd5af nodeName:}" failed. No retries permitted until 2026-07-01 17:40:47.670530655 +0000 UTC m=+100.178182263 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls") pod "dns-default-qqlpj" (UID: "d789de5a-1fb9-4e71-86b6-3d6bb86cd5af") : secret "dns-default-metrics-tls" not found Jul 01 17:40:16.578798 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:16.578757 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:16.578992 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:16.578928 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 17:40:16.579107 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:16.579000 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls podName:ac5119dc-b7bc-4f92-8536-c33eea6df5b4 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:24.578984521 +0000 UTC m=+77.086636111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-pgtd9" (UID: "ac5119dc-b7bc-4f92-8536-c33eea6df5b4") : secret "samples-operator-tls" not found Jul 01 17:40:19.268310 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:19.268266 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nh728" event={"ID":"35e8d50c-f601-4840-8909-8d462a7d6953","Type":"ContainerStarted","Data":"db1e6cf36fdb6a9c47b01b99a31ecb3ca925a844417f0c8fd6cdea051fcae32e"} Jul 01 17:40:19.287660 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:19.287593 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nh728" podStartSLOduration=66.080749465 podStartE2EDuration="1m10.287572719s" totalImagesPullingTime="4.206823254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:19.286786801 +0000 UTC m=+71.794438410" watchObservedRunningTime="2026-07-01 17:40:19.287572719 +0000 UTC m=+71.795224330" Jul 01 17:40:20.511763 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:20.511702 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:20.512187 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:20.511790 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:20.512187 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:20.511882 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:20.512187 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:20.511949 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls podName:105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:36.511932783 +0000 UTC m=+89.019584369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d79pv" (UID: "105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:20.512333 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:20.512312 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:21.276026 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:21.275992 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wq6jk" event={"ID":"7cbfd800-dc00-43a9-9ece-aebf1e56c67c","Type":"ContainerStarted","Data":"fa90c3fc7669cf8008211bce301a04d4c7bedb99644c9c20a32e452706a8ec61"} Jul 01 17:40:21.276175 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:21.276064 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:40:21.296788 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:21.296751 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wq6jk" podStartSLOduration=65.759736323 podStartE2EDuration="1m12.296738943s" totalImagesPullingTime="6.53700262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:21.29513136 +0000 UTC m=+73.802782968" watchObservedRunningTime="2026-07-01 17:40:21.296738943 +0000 UTC m=+73.804390579" Jul 01 17:40:24.644147 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:24.644112 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:24.646524 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:24.646503 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac5119dc-b7bc-4f92-8536-c33eea6df5b4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-pgtd9\" (UID: \"ac5119dc-b7bc-4f92-8536-c33eea6df5b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:24.788596 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:24.788556 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" Jul 01 17:40:24.934096 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:24.934015 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9"] Jul 01 17:40:25.288962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:25.288875 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" event={"ID":"ac5119dc-b7bc-4f92-8536-c33eea6df5b4","Type":"ContainerStarted","Data":"3ddfe13e13f47586e0dd8da64c4b156c46ef84df3cb17a01cb798c3382ab8c07"} Jul 01 17:40:28.299704 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:28.299666 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" event={"ID":"ac5119dc-b7bc-4f92-8536-c33eea6df5b4","Type":"ContainerStarted","Data":"3643d9112f03c1dbabb9cc8829afd37a8842e3e10a441ec87ebf57a3349484bc"} Jul 01 17:40:28.300093 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:28.299751 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" event={"ID":"ac5119dc-b7bc-4f92-8536-c33eea6df5b4","Type":"ContainerStarted","Data":"a09377a3294338cfbdc01b915fadfd2030726358e141e19ee819b9e1e2d95c6a"} Jul 01 17:40:28.321388 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:28.321337 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-pgtd9" podStartSLOduration=17.81800452 podStartE2EDuration="20.321323333s" totalImagesPullingTime="2.503318813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:28.320037478 +0000 UTC m=+80.827689086" watchObservedRunningTime="2026-07-01 17:40:28.321323333 +0000 UTC m=+80.828974937" Jul 01 17:40:30.589817 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:30.589704 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:40:30.592218 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:30.592187 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2384345-9f55-49e3-9dae-21b506857126-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-gxjb2\" (UID: \"b2384345-9f55-49e3-9dae-21b506857126\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:40:30.883107 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:30.883080 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s7drq\"" Jul 01 17:40:30.888090 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:30.888071 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" Jul 01 17:40:31.010579 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:31.010540 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2"] Jul 01 17:40:31.013307 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:31.013284 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2384345_9f55_49e3_9dae_21b506857126.slice/crio-a3ff6fbd1d705001cd6c89f48c1daf909cead40bd34939cc5bc8ee13fbe022bd WatchSource:0}: Error finding container a3ff6fbd1d705001cd6c89f48c1daf909cead40bd34939cc5bc8ee13fbe022bd: Status 404 returned error can't find the container with id a3ff6fbd1d705001cd6c89f48c1daf909cead40bd34939cc5bc8ee13fbe022bd Jul 01 17:40:31.309152 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:31.309055 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" event={"ID":"b2384345-9f55-49e3-9dae-21b506857126","Type":"ContainerStarted","Data":"a3ff6fbd1d705001cd6c89f48c1daf909cead40bd34939cc5bc8ee13fbe022bd"} Jul 01 17:40:34.325762 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:34.325727 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" event={"ID":"b2384345-9f55-49e3-9dae-21b506857126","Type":"ContainerStarted","Data":"ce451a7834aa88f19a8b6c2ab15d5b28f3381f1e525431da346ddd2da0722ddc"} Jul 01 17:40:34.353440 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:34.353395 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-gxjb2" podStartSLOduration=34.013685858 podStartE2EDuration="36.353379946s" totalImagesPullingTime="2.339694088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:34.3519948 +0000 UTC m=+86.859646408" watchObservedRunningTime="2026-07-01 17:40:34.353379946 +0000 UTC m=+86.861031554" Jul 01 17:40:36.531439 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:36.531399 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:36.533793 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:36.533770 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d79pv\" (UID: \"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51\") " pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:36.790166 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:36.790094 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sc8wz\"" Jul 01 17:40:36.796894 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:36.796876 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d79pv" Jul 01 17:40:36.936733 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:36.936712 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d79pv"] Jul 01 17:40:36.939034 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:36.939007 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105f2e7a_e3ca_43cb_bd8a_b9faecbd2c51.slice/crio-2a802f73aadd487f29da56a43a50fe7d8c3064b2df9c13e6503aaa52b8d147e2 WatchSource:0}: Error finding container 2a802f73aadd487f29da56a43a50fe7d8c3064b2df9c13e6503aaa52b8d147e2: Status 404 returned error can't find the container with id 2a802f73aadd487f29da56a43a50fe7d8c3064b2df9c13e6503aaa52b8d147e2 Jul 01 17:40:37.337298 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:37.337252 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d79pv" event={"ID":"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51","Type":"ContainerStarted","Data":"2a802f73aadd487f29da56a43a50fe7d8c3064b2df9c13e6503aaa52b8d147e2"} Jul 01 17:40:40.282985 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.282942 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z"] Jul 01 17:40:40.295459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.295432 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc"] Jul 01 17:40:40.295614 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.295572 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" Jul 01 17:40:40.299911 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.299885 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh"] Jul 01 17:40:40.300037 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.300000 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.304046 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.303903 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 17:40:40.305270 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.305243 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" Jul 01 17:40:40.305538 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.305507 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 17:40:40.305538 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.305522 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 17:40:40.305743 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.305726 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 17:40:40.305800 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.305757 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4bnkj\"" Jul 01 17:40:40.305900 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.305872 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 17:40:40.306297 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.306277 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 17:40:40.308497 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.308476 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z"] Jul 01 17:40:40.309861 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.309842 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc"] Jul 01 17:40:40.317859 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.317837 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 17:40:40.317977 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.317836 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-l7c27\"" Jul 01 17:40:40.330388 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.330359 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh"] Jul 01 17:40:40.461682 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.461553 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q5k5\" (UniqueName: \"kubernetes.io/projected/e081bf94-5345-429a-b444-34ba6d4c28b9-kube-api-access-7q5k5\") pod \"managed-serviceaccount-addon-agent-bdc47456d-bk7fh\" (UID: \"e081bf94-5345-429a-b444-34ba6d4c28b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" Jul 01 17:40:40.461682 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.461589 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ff6219f-dcf7-4588-a127-15daffea131b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-vc96z\" (UID: \"4ff6219f-dcf7-4588-a127-15daffea131b\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" Jul 01 17:40:40.461682 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.461614 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ff6219f-dcf7-4588-a127-15daffea131b-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-vc96z\" (UID: \"4ff6219f-dcf7-4588-a127-15daffea131b\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" Jul 01 17:40:40.461967 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.461716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn6ml\" (UniqueName: \"kubernetes.io/projected/db675c90-277b-44b3-b437-a0c503b619e4-kube-api-access-sn6ml\") pod \"klusterlet-addon-workmgr-79897d54fc-z28pc\" (UID: \"db675c90-277b-44b3-b437-a0c503b619e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.461967 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.461818 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e081bf94-5345-429a-b444-34ba6d4c28b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdc47456d-bk7fh\" (UID: \"e081bf94-5345-429a-b444-34ba6d4c28b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" Jul 01 17:40:40.461967 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.461843 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db675c90-277b-44b3-b437-a0c503b619e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-79897d54fc-z28pc\" (UID: \"db675c90-277b-44b3-b437-a0c503b619e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.461967 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.461871 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db675c90-277b-44b3-b437-a0c503b619e4-tmp\") pod \"klusterlet-addon-workmgr-79897d54fc-z28pc\" (UID: \"db675c90-277b-44b3-b437-a0c503b619e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.562744 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.562658 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e081bf94-5345-429a-b444-34ba6d4c28b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdc47456d-bk7fh\" (UID: \"e081bf94-5345-429a-b444-34ba6d4c28b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" Jul 01 17:40:40.562744 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.562716 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db675c90-277b-44b3-b437-a0c503b619e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-79897d54fc-z28pc\" (UID: \"db675c90-277b-44b3-b437-a0c503b619e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.562946 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.562751 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db675c90-277b-44b3-b437-a0c503b619e4-tmp\") pod \"klusterlet-addon-workmgr-79897d54fc-z28pc\" (UID: \"db675c90-277b-44b3-b437-a0c503b619e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.562946 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.562819 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q5k5\" (UniqueName: \"kubernetes.io/projected/e081bf94-5345-429a-b444-34ba6d4c28b9-kube-api-access-7q5k5\") pod \"managed-serviceaccount-addon-agent-bdc47456d-bk7fh\" (UID: \"e081bf94-5345-429a-b444-34ba6d4c28b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" Jul 01 17:40:40.562946 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.562845 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ff6219f-dcf7-4588-a127-15daffea131b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-vc96z\" (UID: \"4ff6219f-dcf7-4588-a127-15daffea131b\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" Jul 01 17:40:40.562946 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.562873 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ff6219f-dcf7-4588-a127-15daffea131b-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-vc96z\" (UID: \"4ff6219f-dcf7-4588-a127-15daffea131b\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" Jul 01 17:40:40.562946 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.562909 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn6ml\" (UniqueName: \"kubernetes.io/projected/db675c90-277b-44b3-b437-a0c503b619e4-kube-api-access-sn6ml\") pod \"klusterlet-addon-workmgr-79897d54fc-z28pc\" (UID: \"db675c90-277b-44b3-b437-a0c503b619e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.563455 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.563423 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db675c90-277b-44b3-b437-a0c503b619e4-tmp\") pod \"klusterlet-addon-workmgr-79897d54fc-z28pc\" (UID: \"db675c90-277b-44b3-b437-a0c503b619e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.563951 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.563928 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ff6219f-dcf7-4588-a127-15daffea131b-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-vc96z\" (UID: \"4ff6219f-dcf7-4588-a127-15daffea131b\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" Jul 01 17:40:40.566220 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.565635 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e081bf94-5345-429a-b444-34ba6d4c28b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdc47456d-bk7fh\" (UID: \"e081bf94-5345-429a-b444-34ba6d4c28b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" Jul 01 17:40:40.566220 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.566058 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db675c90-277b-44b3-b437-a0c503b619e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-79897d54fc-z28pc\" (UID: \"db675c90-277b-44b3-b437-a0c503b619e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.566220 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.566085 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ff6219f-dcf7-4588-a127-15daffea131b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-vc96z\" (UID: \"4ff6219f-dcf7-4588-a127-15daffea131b\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" Jul 01 17:40:40.586339 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.586279 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q5k5\" (UniqueName: \"kubernetes.io/projected/e081bf94-5345-429a-b444-34ba6d4c28b9-kube-api-access-7q5k5\") pod \"managed-serviceaccount-addon-agent-bdc47456d-bk7fh\" (UID: \"e081bf94-5345-429a-b444-34ba6d4c28b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" Jul 01 17:40:40.587400 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.587373 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn6ml\" (UniqueName: \"kubernetes.io/projected/db675c90-277b-44b3-b437-a0c503b619e4-kube-api-access-sn6ml\") pod \"klusterlet-addon-workmgr-79897d54fc-z28pc\" (UID: \"db675c90-277b-44b3-b437-a0c503b619e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.608133 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.608103 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" Jul 01 17:40:40.614917 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.614896 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:40.636571 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.636542 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" Jul 01 17:40:40.816996 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.816935 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh"] Jul 01 17:40:40.818624 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:40.818595 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode081bf94_5345_429a_b444_34ba6d4c28b9.slice/crio-9ee912dfbc2e95d05fe4701e7090b2b88b72cd240b388bf2ee7e090432df71d0 WatchSource:0}: Error finding container 9ee912dfbc2e95d05fe4701e7090b2b88b72cd240b388bf2ee7e090432df71d0: Status 404 returned error can't find the container with id 9ee912dfbc2e95d05fe4701e7090b2b88b72cd240b388bf2ee7e090432df71d0 Jul 01 17:40:40.831113 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.831088 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc"] Jul 01 17:40:40.833409 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:40.833372 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb675c90_277b_44b3_b437_a0c503b619e4.slice/crio-d02c407611a0c600a949c679e79ee81db25e7a3ca763e844781d475fc23cb8a0 WatchSource:0}: Error finding container d02c407611a0c600a949c679e79ee81db25e7a3ca763e844781d475fc23cb8a0: Status 404 returned error can't find the container with id d02c407611a0c600a949c679e79ee81db25e7a3ca763e844781d475fc23cb8a0 Jul 01 17:40:40.854084 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:40.854061 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z"] Jul 01 17:40:40.856779 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:40.856758 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff6219f_dcf7_4588_a127_15daffea131b.slice/crio-5fef8a787c41dbabd782be90132198f499fe55da597626404b99a10e96b4bb60 WatchSource:0}: Error finding container 5fef8a787c41dbabd782be90132198f499fe55da597626404b99a10e96b4bb60: Status 404 returned error can't find the container with id 5fef8a787c41dbabd782be90132198f499fe55da597626404b99a10e96b4bb60 Jul 01 17:40:41.353977 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:41.353942 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" event={"ID":"4ff6219f-dcf7-4588-a127-15daffea131b","Type":"ContainerStarted","Data":"5fef8a787c41dbabd782be90132198f499fe55da597626404b99a10e96b4bb60"} Jul 01 17:40:41.355058 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:41.355036 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" event={"ID":"db675c90-277b-44b3-b437-a0c503b619e4","Type":"ContainerStarted","Data":"d02c407611a0c600a949c679e79ee81db25e7a3ca763e844781d475fc23cb8a0"} Jul 01 17:40:41.356247 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:41.356227 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d79pv" event={"ID":"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51","Type":"ContainerStarted","Data":"1f5209ac1fbb4d3b436004d24c8921eabc808e814b5440792f0146a8b3bee30a"} Jul 01 17:40:41.358671 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:41.358609 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" event={"ID":"e081bf94-5345-429a-b444-34ba6d4c28b9","Type":"ContainerStarted","Data":"9ee912dfbc2e95d05fe4701e7090b2b88b72cd240b388bf2ee7e090432df71d0"} Jul 01 17:40:43.367098 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:43.367059 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" event={"ID":"4ff6219f-dcf7-4588-a127-15daffea131b","Type":"ContainerStarted","Data":"5883226e812bae5c395274416689bec1a88b45dd50ba09375e25e1d06d7642a0"} Jul 01 17:40:43.385525 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:43.385438 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-vc96z" podStartSLOduration=1.087770521 podStartE2EDuration="3.38541686s" totalImagesPullingTime="2.297646339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:43.384234301 +0000 UTC m=+95.891885928" watchObservedRunningTime="2026-07-01 17:40:43.38541686 +0000 UTC m=+95.893068469" Jul 01 17:40:44.373883 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:44.373849 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" event={"ID":"e081bf94-5345-429a-b444-34ba6d4c28b9","Type":"ContainerStarted","Data":"a6c4c433c6d7d8f2cf6090910839142c3e471d89e4a9f8c8d667532936f11995"} Jul 01 17:40:44.392008 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:44.391966 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc47456d-bk7fh" podStartSLOduration=1.036325331 podStartE2EDuration="4.391952421s" totalImagesPullingTime="3.35562709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:44.39187658 +0000 UTC m=+96.899528189" watchObservedRunningTime="2026-07-01 17:40:44.391952421 +0000 UTC m=+96.899604030" Jul 01 17:40:45.378959 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:45.378927 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d79pv" event={"ID":"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51","Type":"ContainerStarted","Data":"efb22281f84462a2b1bac60953690fa2310cc85bdb21bbb036d8a1fee87cdb6e"} Jul 01 17:40:47.387494 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:47.387452 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" event={"ID":"db675c90-277b-44b3-b437-a0c503b619e4","Type":"ContainerStarted","Data":"53aece7aa596bf223c7ef3f01dd06eb4ed74736ee2d3c247990c01f119d62c1a"} Jul 01 17:40:47.387998 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:47.387674 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:47.389382 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:47.389361 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" Jul 01 17:40:47.456995 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:47.456945 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79897d54fc-z28pc" podStartSLOduration=1.671517282 podStartE2EDuration="7.456928845s" totalImagesPullingTime="5.785411563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:47.414163756 +0000 UTC m=+99.921815376" watchObservedRunningTime="2026-07-01 17:40:47.456928845 +0000 UTC m=+99.964580453" Jul 01 17:40:47.723399 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:47.723308 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:40:47.725812 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:47.725793 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d789de5a-1fb9-4e71-86b6-3d6bb86cd5af-metrics-tls\") pod \"dns-default-qqlpj\" (UID: \"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af\") " pod="openshift-dns/dns-default-qqlpj" Jul 01 17:40:47.734157 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:47.734136 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c4xn\"" Jul 01 17:40:47.739965 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:47.739952 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qqlpj" Jul 01 17:40:47.876723 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:47.876691 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qqlpj"] Jul 01 17:40:47.880179 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:47.879813 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd789de5a_1fb9_4e71_86b6_3d6bb86cd5af.slice/crio-59f2cc397591e7b188dbcbea00a3b40a558bf296a1941279fc3b10a36b138c4f WatchSource:0}: Error finding container 59f2cc397591e7b188dbcbea00a3b40a558bf296a1941279fc3b10a36b138c4f: Status 404 returned error can't find the container with id 59f2cc397591e7b188dbcbea00a3b40a558bf296a1941279fc3b10a36b138c4f Jul 01 17:40:48.392963 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:48.392926 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qqlpj" event={"ID":"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af","Type":"ContainerStarted","Data":"59f2cc397591e7b188dbcbea00a3b40a558bf296a1941279fc3b10a36b138c4f"} Jul 01 17:40:50.506501 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.506469 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-mslhn"] Jul 01 17:40:50.511333 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.511314 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.526714 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.526693 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 17:40:50.535966 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.535945 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 17:40:50.537382 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.537342 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-95ghd\"" Jul 01 17:40:50.537382 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.537352 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 17:40:50.537521 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.537402 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 17:40:50.545951 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.545927 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-mslhn"] Jul 01 17:40:50.572353 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.572330 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x5jdg"] Jul 01 17:40:50.575444 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.575429 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.579777 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.579739 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 17:40:50.579980 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.579962 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 17:40:50.580126 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.580088 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lxnhk\"" Jul 01 17:40:50.580260 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.580246 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 17:40:50.648336 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.648310 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.648468 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.648368 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.648536 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.648481 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.648536 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.648521 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-metrics-client-ca\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.648634 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.648543 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txqmc\" (UniqueName: \"kubernetes.io/projected/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-api-access-txqmc\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.648634 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.648611 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.749088 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-root\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.749271 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749105 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.749271 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749164 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-sys\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.749271 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749217 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.749271 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-metrics-client-ca\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.749487 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txqmc\" (UniqueName: \"kubernetes.io/projected/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-api-access-txqmc\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.749487 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749309 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-tls\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.749487 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749324 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-wtmp\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.749487 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749349 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-metrics-client-ca\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.749487 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749446 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqllr\" (UniqueName: \"kubernetes.io/projected/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-kube-api-access-bqllr\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.749487 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749473 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.749782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749488 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.749782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.749782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749576 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.749782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.749782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.749772 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-textfile\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.750065 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.750046 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-metrics-client-ca\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.750288 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.750261 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.752375 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.752346 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.752567 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.752548 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.760281 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.760254 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txqmc\" (UniqueName: \"kubernetes.io/projected/c2ffda4a-2647-449d-8a9f-ef7ba55efba5-kube-api-access-txqmc\") pod \"kube-state-metrics-845b954455-mslhn\" (UID: \"c2ffda4a-2647-449d-8a9f-ef7ba55efba5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.850220 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850185 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850220 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850226 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-textfile\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850262 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-root\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-sys\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850331 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-tls\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850354 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-wtmp\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850379 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-metrics-client-ca\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850459 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850389 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-root\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850840 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850524 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-wtmp\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850840 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850402 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqllr\" (UniqueName: \"kubernetes.io/projected/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-kube-api-access-bqllr\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850840 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850399 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-sys\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.850840 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850702 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-textfile\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.851021 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.850970 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.851124 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.851109 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-metrics-client-ca\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.852858 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.852839 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-tls\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.852977 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.852863 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.865626 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.865591 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqllr\" (UniqueName: \"kubernetes.io/projected/fdc3a7b2-6034-4d1a-8a71-e2652caee88d-kube-api-access-bqllr\") pod \"node-exporter-x5jdg\" (UID: \"fdc3a7b2-6034-4d1a-8a71-e2652caee88d\") " pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.893580 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.893548 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" Jul 01 17:40:50.907579 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:50.907562 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5jdg" Jul 01 17:40:50.917520 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:50.917490 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc3a7b2_6034_4d1a_8a71_e2652caee88d.slice/crio-dceb49f0feb4b81d082b1eb7c9c0654817ff0deea0181005b422f64e13ae7416 WatchSource:0}: Error finding container dceb49f0feb4b81d082b1eb7c9c0654817ff0deea0181005b422f64e13ae7416: Status 404 returned error can't find the container with id dceb49f0feb4b81d082b1eb7c9c0654817ff0deea0181005b422f64e13ae7416 Jul 01 17:40:51.037747 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:51.037701 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-mslhn"] Jul 01 17:40:51.041049 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:51.041028 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ffda4a_2647_449d_8a9f_ef7ba55efba5.slice/crio-7f17314ad52734e22d9a99529f28a968859c0cafeec2f747360dd5df93c83608 WatchSource:0}: Error finding container 7f17314ad52734e22d9a99529f28a968859c0cafeec2f747360dd5df93c83608: Status 404 returned error can't find the container with id 7f17314ad52734e22d9a99529f28a968859c0cafeec2f747360dd5df93c83608 Jul 01 17:40:51.405342 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:51.405310 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5jdg" event={"ID":"fdc3a7b2-6034-4d1a-8a71-e2652caee88d","Type":"ContainerStarted","Data":"dceb49f0feb4b81d082b1eb7c9c0654817ff0deea0181005b422f64e13ae7416"} Jul 01 17:40:51.406468 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:51.406442 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" event={"ID":"c2ffda4a-2647-449d-8a9f-ef7ba55efba5","Type":"ContainerStarted","Data":"7f17314ad52734e22d9a99529f28a968859c0cafeec2f747360dd5df93c83608"} Jul 01 17:40:51.408258 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:51.408232 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qqlpj" event={"ID":"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af","Type":"ContainerStarted","Data":"4f5a891cc2c07bc5f25f1a35e18e67e9662112b3fa8de2cbf0cee760e0c8e0cf"} Jul 01 17:40:51.408359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:51.408281 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qqlpj" event={"ID":"d789de5a-1fb9-4e71-86b6-3d6bb86cd5af","Type":"ContainerStarted","Data":"8560ad3c72fd9903f837cc81f9857169c77ed3a4512e6154a6777adea9b1c94a"} Jul 01 17:40:51.408359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:51.408334 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qqlpj" Jul 01 17:40:51.410202 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:51.410184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d79pv" event={"ID":"105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51","Type":"ContainerStarted","Data":"5bc3a9884a3d0f21a2ea011b531c3625f8faccae53476b3b26a7093d184646ea"} Jul 01 17:40:51.436271 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:51.436228 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qqlpj" podStartSLOduration=65.867064894 podStartE2EDuration="1m8.436213161s" totalImagesPullingTime="2.569148267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:51.434090086 +0000 UTC m=+103.941741695" watchObservedRunningTime="2026-07-01 17:40:51.436213161 +0000 UTC m=+103.943864768" Jul 01 17:40:51.458803 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:51.458753 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d79pv" podStartSLOduration=34.129228513 podStartE2EDuration="47.458736133s" totalImagesPullingTime="13.32950762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:40:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:51.458282855 +0000 UTC m=+103.965934476" watchObservedRunningTime="2026-07-01 17:40:51.458736133 +0000 UTC m=+103.966387742" Jul 01 17:40:52.281962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:52.281926 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wq6jk" Jul 01 17:40:53.407276 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.407225 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-668999d584-8kzfl"] Jul 01 17:40:53.428001 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.427967 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" event={"ID":"c2ffda4a-2647-449d-8a9f-ef7ba55efba5","Type":"ContainerStarted","Data":"1c1ad8155f54a0723e7fddafbfad2220e0caf8f6ee100ba131c8ab7392f60506"} Jul 01 17:40:53.428157 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.428024 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" event={"ID":"c2ffda4a-2647-449d-8a9f-ef7ba55efba5","Type":"ContainerStarted","Data":"335d14bc72e53eca79f8a3090661ae52654c394bce0c45ca534f1674b457b3d4"} Jul 01 17:40:53.428157 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.428053 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" event={"ID":"c2ffda4a-2647-449d-8a9f-ef7ba55efba5","Type":"ContainerStarted","Data":"c4eec8ee84ed0a09ead438f6dfe08d2979f613e6b0a78b11963478573b4fd2dd"} Jul 01 17:40:53.428157 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.428147 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.434873 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.434750 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 17:40:53.434873 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.434751 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 17:40:53.435159 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.434750 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 17:40:53.435249 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.435232 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 17:40:53.435302 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.435285 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-877jl9m858u4r\"" Jul 01 17:40:53.435350 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.435239 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-d8tx2\"" Jul 01 17:40:53.435350 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.435337 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 17:40:53.442110 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.442088 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-668999d584-8kzfl"] Jul 01 17:40:53.456678 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.456609 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-mslhn" podStartSLOduration=1.50415987 podStartE2EDuration="3.456595381s" totalImagesPullingTime="1.952435511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:53.455293829 +0000 UTC m=+105.962945439" watchObservedRunningTime="2026-07-01 17:40:53.456595381 +0000 UTC m=+105.964246989" Jul 01 17:40:53.572937 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.572853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-tls\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.573086 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.572950 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fde2491-da20-4075-9b10-711dfe2675ad-metrics-client-ca\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.573086 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.573025 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.573086 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.573052 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.573241 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.573138 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-grpc-tls\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.573241 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.573201 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.573339 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.573258 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lx4f\" (UniqueName: \"kubernetes.io/projected/0fde2491-da20-4075-9b10-711dfe2675ad-kube-api-access-2lx4f\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.573339 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.573292 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.674332 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.674288 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.674332 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.674334 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.674566 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.674362 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-grpc-tls\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.674566 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.674402 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.674566 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.674435 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lx4f\" (UniqueName: \"kubernetes.io/projected/0fde2491-da20-4075-9b10-711dfe2675ad-kube-api-access-2lx4f\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.676037 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.675015 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.676037 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.675339 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-tls\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.676037 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.675618 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fde2491-da20-4075-9b10-711dfe2675ad-metrics-client-ca\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.677508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.677477 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fde2491-da20-4075-9b10-711dfe2675ad-metrics-client-ca\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.678217 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.678186 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.678313 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.678236 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.680860 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.678581 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.680860 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.678983 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-tls\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.682277 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.682256 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-grpc-tls\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.682915 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.682895 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0fde2491-da20-4075-9b10-711dfe2675ad-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.687550 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.687531 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lx4f\" (UniqueName: \"kubernetes.io/projected/0fde2491-da20-4075-9b10-711dfe2675ad-kube-api-access-2lx4f\") pod \"thanos-querier-668999d584-8kzfl\" (UID: \"0fde2491-da20-4075-9b10-711dfe2675ad\") " pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.738159 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.738133 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:40:53.902113 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:53.902065 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-668999d584-8kzfl"] Jul 01 17:40:53.904216 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:53.904189 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fde2491_da20_4075_9b10_711dfe2675ad.slice/crio-7156f6ab90ee625233210fc32658eaee2ce6c922154e0f4ba978ccba2446f91d WatchSource:0}: Error finding container 7156f6ab90ee625233210fc32658eaee2ce6c922154e0f4ba978ccba2446f91d: Status 404 returned error can't find the container with id 7156f6ab90ee625233210fc32658eaee2ce6c922154e0f4ba978ccba2446f91d Jul 01 17:40:54.426079 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:54.426046 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" event={"ID":"0fde2491-da20-4075-9b10-711dfe2675ad","Type":"ContainerStarted","Data":"7156f6ab90ee625233210fc32658eaee2ce6c922154e0f4ba978ccba2446f91d"} Jul 01 17:40:55.225831 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.225801 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2"] Jul 01 17:40:55.228917 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.228902 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:55.232498 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.232477 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 17:40:55.232663 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.232512 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-m84dw\"" Jul 01 17:40:55.248926 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.248895 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2"] Jul 01 17:40:55.291004 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.290976 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nzts\" (UniqueName: \"kubernetes.io/projected/9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a-kube-api-access-9nzts\") pod \"monitoring-plugin-cd8656b8-hbxw2\" (UID: \"9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:55.291143 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.291012 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-hbxw2\" (UID: \"9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:55.391821 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.391786 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nzts\" (UniqueName: \"kubernetes.io/projected/9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a-kube-api-access-9nzts\") pod \"monitoring-plugin-cd8656b8-hbxw2\" (UID: \"9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:55.391821 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.391821 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-hbxw2\" (UID: \"9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:55.392024 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:55.391947 2557 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 01 17:40:55.392024 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:40:55.391999 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a-monitoring-plugin-cert podName:9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a nodeName:}" failed. No retries permitted until 2026-07-01 17:40:55.891984601 +0000 UTC m=+108.399636187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-hbxw2" (UID: "9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a") : secret "monitoring-plugin-cert" not found Jul 01 17:40:55.401330 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.401297 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nzts\" (UniqueName: \"kubernetes.io/projected/9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a-kube-api-access-9nzts\") pod \"monitoring-plugin-cd8656b8-hbxw2\" (UID: \"9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:55.430805 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.430776 2557 generic.go:356] "Generic (PLEG): container finished" podID="fdc3a7b2-6034-4d1a-8a71-e2652caee88d" containerID="7af17631c83d7712b91a01e79972c0983fe65a0a9ebd3c1e8c78e7c4abd483a5" exitCode=0 Jul 01 17:40:55.431147 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.430865 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5jdg" event={"ID":"fdc3a7b2-6034-4d1a-8a71-e2652caee88d","Type":"ContainerDied","Data":"7af17631c83d7712b91a01e79972c0983fe65a0a9ebd3c1e8c78e7c4abd483a5"} Jul 01 17:40:55.895574 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.895536 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-hbxw2\" (UID: \"9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:55.898202 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:55.898167 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-hbxw2\" (UID: \"9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:56.138425 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:56.138389 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:56.292478 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:56.292446 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2"] Jul 01 17:40:56.295674 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:56.295633 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f7998f5_3ae4_4b31_8e16_d1a05a2d1f7a.slice/crio-b4ef1b65ae91c918b718adf28ebd26eef6f75c88628b9968aef62233841fa5ba WatchSource:0}: Error finding container b4ef1b65ae91c918b718adf28ebd26eef6f75c88628b9968aef62233841fa5ba: Status 404 returned error can't find the container with id b4ef1b65ae91c918b718adf28ebd26eef6f75c88628b9968aef62233841fa5ba Jul 01 17:40:56.437033 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:56.436943 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5jdg" event={"ID":"fdc3a7b2-6034-4d1a-8a71-e2652caee88d","Type":"ContainerStarted","Data":"46d4c8e3b0a2e498d9db146aaad1da6274ccb302eeddc35da75f55e56cf231ff"} Jul 01 17:40:56.437033 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:56.437002 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5jdg" event={"ID":"fdc3a7b2-6034-4d1a-8a71-e2652caee88d","Type":"ContainerStarted","Data":"75ba866f75a7a30766d8b4358c13568fc8a2a5a047b479fefadd810b42f17f28"} Jul 01 17:40:56.438243 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:56.438211 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" event={"ID":"9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a","Type":"ContainerStarted","Data":"b4ef1b65ae91c918b718adf28ebd26eef6f75c88628b9968aef62233841fa5ba"} Jul 01 17:40:57.037622 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.037568 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x5jdg" podStartSLOduration=3.423081758 podStartE2EDuration="7.037551548s" totalImagesPullingTime="3.542250857s" totalInitContainerRuntime="72.218933ms" isStatefulPod=true podCreationTimestamp="2026-07-01 17:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:56.465479425 +0000 UTC m=+108.973131032" watchObservedRunningTime="2026-07-01 17:40:57.037551548 +0000 UTC m=+109.545203155" Jul 01 17:40:57.038494 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.038472 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:40:57.041974 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.041957 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.063787 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.063758 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 17:40:57.063959 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.063877 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 17:40:57.063959 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.063877 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 17:40:57.064084 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.063969 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 17:40:57.064084 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.064008 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 17:40:57.064238 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.064196 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 17:40:57.065099 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.065069 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 17:40:57.065208 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.065121 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 17:40:57.065208 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.065152 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aq1h6uj80kf89\"" Jul 01 17:40:57.065400 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.065382 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 17:40:57.065740 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.065704 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 17:40:57.065927 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.065912 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 17:40:57.066031 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.066013 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jt6jn\"" Jul 01 17:40:57.066603 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.066584 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 17:40:57.085827 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.085752 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 17:40:57.095530 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.095486 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 17:40:57.097104 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.097078 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:40:57.097924 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.097907 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 17:40:57.108782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.108752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.108915 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.108811 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.108915 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.108843 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.108915 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.108880 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.108915 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.108909 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109068 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.108942 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109068 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.108966 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109068 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109012 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109068 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109035 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109068 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109250 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109083 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109250 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109119 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109250 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109141 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6h5f\" (UniqueName: \"kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-kube-api-access-g6h5f\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109250 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109169 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109250 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109212 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-config\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109250 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109237 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109449 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109279 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109449 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109306 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109449 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109330 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.109449 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.109353 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.210482 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210451 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.210482 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210485 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6h5f\" (UniqueName: \"kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-kube-api-access-g6h5f\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.210736 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210504 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.210736 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210526 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-config\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.210736 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210544 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.210736 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210686 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.210736 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210703 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.210736 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210726 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.211214 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210742 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.211214 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210764 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.211214 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210802 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.211214 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.210828 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.211835 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.211806 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.212467 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212148 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.212467 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212386 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.212720 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212689 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.212794 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212746 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.212794 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212781 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.212903 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212826 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.212903 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212852 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.213006 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212907 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.213006 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212936 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.213006 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212961 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.213006 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.212983 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.213576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.213548 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.215962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.214778 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.215962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.214968 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.215962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.214985 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.215962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.215213 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-config\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.215962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.215345 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.215962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.215765 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.215962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.215829 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.216248 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.216062 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.216332 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.216314 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.216403 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.216345 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.216898 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.216869 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.216984 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.216922 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.217114 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.217097 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.217734 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.217719 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.279513 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.279486 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6h5f\" (UniqueName: \"kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-kube-api-access-g6h5f\") pod \"prometheus-k8s-0\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.353715 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.353676 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:40:57.541852 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:57.541726 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:40:57.545041 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:40:57.545010 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9550fa8_e72c_497c_a538_1e9940677af1.slice/crio-fe7410d492999f1a3eb9471e4c1a8d200c9bf36354e753fc19afee626e3c039d WatchSource:0}: Error finding container fe7410d492999f1a3eb9471e4c1a8d200c9bf36354e753fc19afee626e3c039d: Status 404 returned error can't find the container with id fe7410d492999f1a3eb9471e4c1a8d200c9bf36354e753fc19afee626e3c039d Jul 01 17:40:58.449066 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:58.449031 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerStarted","Data":"fe7410d492999f1a3eb9471e4c1a8d200c9bf36354e753fc19afee626e3c039d"} Jul 01 17:40:59.455249 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:59.455209 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" event={"ID":"9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a","Type":"ContainerStarted","Data":"dc9a602f62f8efab82b56bfb7b5c743b78d910ece8d7b6b5a39a71a187e0919d"} Jul 01 17:40:59.455702 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:59.455395 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:59.457782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:59.457751 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" event={"ID":"0fde2491-da20-4075-9b10-711dfe2675ad","Type":"ContainerStarted","Data":"f9731b74c33596b9d9542a89003e8403de2265743637ae3d2d86e034d7028b69"} Jul 01 17:40:59.458061 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:59.457826 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" event={"ID":"0fde2491-da20-4075-9b10-711dfe2675ad","Type":"ContainerStarted","Data":"586b028e9588d7ba583a70653728a639eba4ab14d5d611d9726cb4e2a7d048be"} Jul 01 17:40:59.458061 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:59.457868 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" event={"ID":"0fde2491-da20-4075-9b10-711dfe2675ad","Type":"ContainerStarted","Data":"3ddd93d29c9654e319081938ae1af099fbe3002b672b4a7d46b947fb0f6b7a8a"} Jul 01 17:40:59.459273 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:59.459249 2557 generic.go:356] "Generic (PLEG): container finished" podID="a9550fa8-e72c-497c-a538-1e9940677af1" containerID="1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df" exitCode=0 Jul 01 17:40:59.459384 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:59.459318 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerDied","Data":"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df"} Jul 01 17:40:59.461346 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:59.461326 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" Jul 01 17:40:59.486886 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:40:59.486842 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-hbxw2" podStartSLOduration=1.6381895229999999 podStartE2EDuration="4.486828816s" totalImagesPullingTime="2.848639293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:59.485970614 +0000 UTC m=+111.993622219" watchObservedRunningTime="2026-07-01 17:40:59.486828816 +0000 UTC m=+111.994480424" Jul 01 17:41:00.468846 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:00.468756 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" event={"ID":"0fde2491-da20-4075-9b10-711dfe2675ad","Type":"ContainerStarted","Data":"8045cee608e641b529f1771cd0064328fbaba967439a16812c76812f7f18cdd0"} Jul 01 17:41:00.468846 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:00.468836 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" event={"ID":"0fde2491-da20-4075-9b10-711dfe2675ad","Type":"ContainerStarted","Data":"977acfa04f4bc52bda4d47e367ab4f169dd102c6ab4dda6c4fcf8bad7c1eda3f"} Jul 01 17:41:00.469213 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:00.468875 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" event={"ID":"0fde2491-da20-4075-9b10-711dfe2675ad","Type":"ContainerStarted","Data":"266c0ddf813b9a320f8882ec90c8a1ec447d8f8da5f009f9776445f35d0802cc"} Jul 01 17:41:00.469213 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:00.468914 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:41:00.505664 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:00.505592 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" podStartSLOduration=1.465240331 podStartE2EDuration="7.505571565s" totalImagesPullingTime="6.040331234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:41:00.503813418 +0000 UTC m=+113.011465026" watchObservedRunningTime="2026-07-01 17:41:00.505571565 +0000 UTC m=+113.013223176" Jul 01 17:41:01.416143 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:01.416113 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qqlpj" Jul 01 17:41:03.485579 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:03.485553 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerStarted","Data":"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813"} Jul 01 17:41:04.493268 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:04.493227 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerStarted","Data":"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d"} Jul 01 17:41:04.493746 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:04.493300 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerStarted","Data":"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30"} Jul 01 17:41:04.493746 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:04.493334 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerStarted","Data":"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc"} Jul 01 17:41:04.493746 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:04.493362 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerStarted","Data":"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf"} Jul 01 17:41:04.493746 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:04.493386 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerStarted","Data":"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db"} Jul 01 17:41:04.545190 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:04.545019 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.978899229 podStartE2EDuration="8.544997364s" totalImagesPullingTime="5.541553467s" totalInitContainerRuntime="24.544668ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:41:04.540691957 +0000 UTC m=+117.048343567" watchObservedRunningTime="2026-07-01 17:41:04.544997364 +0000 UTC m=+117.052648974" Jul 01 17:41:06.480099 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:06.480069 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-668999d584-8kzfl" Jul 01 17:41:07.354739 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:07.354695 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:41:17.793339 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:17.793300 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:41:17.795904 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:17.795880 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9405216-0c3e-46c9-9d9d-d4904fccd18f-metrics-certs\") pod \"network-metrics-daemon-qvjbt\" (UID: \"e9405216-0c3e-46c9-9d9d-d4904fccd18f\") " pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:41:17.927889 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:17.927852 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-47mbs\"" Jul 01 17:41:17.934664 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:17.934624 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvjbt" Jul 01 17:41:18.096904 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:18.096873 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qvjbt"] Jul 01 17:41:18.100046 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:41:18.100020 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9405216_0c3e_46c9_9d9d_d4904fccd18f.slice/crio-91e4a3d19bf1e30468f9affcb8e677fa08033548aa4c7bd44290fa83ead7bf4f WatchSource:0}: Error finding container 91e4a3d19bf1e30468f9affcb8e677fa08033548aa4c7bd44290fa83ead7bf4f: Status 404 returned error can't find the container with id 91e4a3d19bf1e30468f9affcb8e677fa08033548aa4c7bd44290fa83ead7bf4f Jul 01 17:41:18.547257 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:18.547230 2557 generic.go:356] "Generic (PLEG): container finished" podID="343d9614-f190-4f47-9195-92c320541bd0" containerID="2e5cef1af480ebfd1e46010171d086e8330c3232758eb16d39cb81078dbebe65" exitCode=0 Jul 01 17:41:18.547447 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:18.547295 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" event={"ID":"343d9614-f190-4f47-9195-92c320541bd0","Type":"ContainerDied","Data":"2e5cef1af480ebfd1e46010171d086e8330c3232758eb16d39cb81078dbebe65"} Jul 01 17:41:18.547618 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:18.547603 2557 scope.go:117] "RemoveContainer" containerID="2e5cef1af480ebfd1e46010171d086e8330c3232758eb16d39cb81078dbebe65" Jul 01 17:41:18.548560 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:18.548535 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvjbt" event={"ID":"e9405216-0c3e-46c9-9d9d-d4904fccd18f","Type":"ContainerStarted","Data":"91e4a3d19bf1e30468f9affcb8e677fa08033548aa4c7bd44290fa83ead7bf4f"} Jul 01 17:41:19.555472 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:19.555440 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-2947m" event={"ID":"343d9614-f190-4f47-9195-92c320541bd0","Type":"ContainerStarted","Data":"f7fca6d046c068be54b4b2f46b9f1155739e4d3ff519a8a4c464eef0346a06c6"} Jul 01 17:41:22.570200 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:22.570162 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvjbt" event={"ID":"e9405216-0c3e-46c9-9d9d-d4904fccd18f","Type":"ContainerStarted","Data":"b4c7dec23c36c396978b4ee3ee6f5a4dccdef4a9b3a59dabb31af57bb1ca3403"} Jul 01 17:41:22.570617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:22.570216 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvjbt" event={"ID":"e9405216-0c3e-46c9-9d9d-d4904fccd18f","Type":"ContainerStarted","Data":"599924302b8615e6d2f21875373a36cb2ca9b4c1a45fedf0fe073650ae483025"} Jul 01 17:41:22.571619 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:22.571592 2557 generic.go:356] "Generic (PLEG): container finished" podID="ac15f280-6a24-44fb-b6a3-83487bcc1319" containerID="7f63a91065dbe35861f67d7b5e8fdb365837b069a7a24d33ce3c57aa6a197a68" exitCode=0 Jul 01 17:41:22.571751 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:22.571632 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" event={"ID":"ac15f280-6a24-44fb-b6a3-83487bcc1319","Type":"ContainerDied","Data":"7f63a91065dbe35861f67d7b5e8fdb365837b069a7a24d33ce3c57aa6a197a68"} Jul 01 17:41:22.571948 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:22.571932 2557 scope.go:117] "RemoveContainer" containerID="7f63a91065dbe35861f67d7b5e8fdb365837b069a7a24d33ce3c57aa6a197a68" Jul 01 17:41:22.649449 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:22.649413 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qvjbt" podStartSLOduration=129.98235621 podStartE2EDuration="2m13.649397321s" totalImagesPullingTime="3.667041111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:41:22.609591522 +0000 UTC m=+135.117243141" watchObservedRunningTime="2026-07-01 17:41:22.649397321 +0000 UTC m=+135.157048929" Jul 01 17:41:23.579065 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:23.579028 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-9xvkx" event={"ID":"ac15f280-6a24-44fb-b6a3-83487bcc1319","Type":"ContainerStarted","Data":"60210c0ad63eda5bec3ebd21805ac381010d6146d79244189f50d0dd8e849a97"} Jul 01 17:41:57.354611 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:57.354569 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:41:57.374044 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:57.374013 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:41:57.729616 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:41:57.729549 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:15.772188 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:15.772152 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:42:15.772782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:15.772512 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="prometheus" containerID="cri-o://80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813" gracePeriod=600 Jul 01 17:42:15.772782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:15.772521 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="config-reloader" containerID="cri-o://ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db" gracePeriod=600 Jul 01 17:42:15.772782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:15.772550 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy-web" containerID="cri-o://4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc" gracePeriod=600 Jul 01 17:42:15.772782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:15.772588 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d" gracePeriod=600 Jul 01 17:42:15.772782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:15.772521 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="thanos-sidecar" containerID="cri-o://a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf" gracePeriod=600 Jul 01 17:42:15.772782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:15.772575 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy" containerID="cri-o://a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30" gracePeriod=600 Jul 01 17:42:16.013638 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.013614 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.076215 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076146 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-2\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076215 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076179 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-grpc-tls\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076215 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076213 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-serving-certs-ca-bundle\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076472 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076244 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-metrics-client-certs\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076472 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076351 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-config\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076472 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076404 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-kubelet-serving-ca-bundle\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076472 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076441 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-db\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076472 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076466 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-metrics-client-ca\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076745 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076508 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-web-config\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076745 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076524 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:42:16.076745 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076536 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-tls-assets\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076745 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076567 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-1\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076745 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076593 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6h5f\" (UniqueName: \"kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-kube-api-access-g6h5f\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076745 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076606 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:42:16.076745 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076621 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076745 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076686 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.076745 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076716 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-0\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.077182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076758 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-tls\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.077182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076805 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-thanos-prometheus-http-client-file\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.077182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076838 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-kube-rbac-proxy\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.077182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076877 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-trusted-ca-bundle\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.077182 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.076901 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-config-out\") pod \"a9550fa8-e72c-497c-a538-1e9940677af1\" (UID: \"a9550fa8-e72c-497c-a538-1e9940677af1\") " Jul 01 17:42:16.077430 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.077233 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:42:16.077430 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.077344 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.077430 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.077368 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.077430 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.077384 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.077634 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.077552 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:42:16.077711 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.077668 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:42:16.079036 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.079004 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:42:16.079162 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.079100 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:42:16.079413 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.079390 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:42:16.079480 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.079454 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:16.079708 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.079682 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:16.080712 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.080684 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-config" (OuterVolumeSpecName: "config") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:16.080979 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.080951 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:16.081287 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.081215 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:16.081697 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.081662 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:16.081797 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.081774 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:42:16.082030 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.082000 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:16.082118 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.082047 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-config-out" (OuterVolumeSpecName: "config-out") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:42:16.082416 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.082399 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-kube-api-access-g6h5f" (OuterVolumeSpecName: "kube-api-access-g6h5f") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "kube-api-access-g6h5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:42:16.083038 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.083020 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:16.095273 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.095243 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-web-config" (OuterVolumeSpecName: "web-config") pod "a9550fa8-e72c-497c-a538-1e9940677af1" (UID: "a9550fa8-e72c-497c-a538-1e9940677af1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:16.178766 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178728 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-web-config\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.178766 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178757 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-tls-assets\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.178766 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178767 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.178766 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178778 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6h5f\" (UniqueName: \"kubernetes.io/projected/a9550fa8-e72c-497c-a538-1e9940677af1-kube-api-access-g6h5f\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178788 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178797 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178805 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178817 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178825 2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178834 2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-kube-rbac-proxy\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178842 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178850 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-config-out\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178858 2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-grpc-tls\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178866 2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-secret-metrics-client-certs\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178873 2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9550fa8-e72c-497c-a538-1e9940677af1-config\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178882 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9550fa8-e72c-497c-a538-1e9940677af1-prometheus-k8s-db\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.179018 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.178890 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9550fa8-e72c-497c-a538-1e9940677af1-configmap-metrics-client-ca\") on node \"ip-10-0-140-89.ec2.internal\" DevicePath \"\"" Jul 01 17:42:16.796127 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796095 2557 generic.go:356] "Generic (PLEG): container finished" podID="a9550fa8-e72c-497c-a538-1e9940677af1" containerID="ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d" exitCode=0 Jul 01 17:42:16.796127 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796125 2557 generic.go:356] "Generic (PLEG): container finished" podID="a9550fa8-e72c-497c-a538-1e9940677af1" containerID="a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30" exitCode=0 Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796133 2557 generic.go:356] "Generic (PLEG): container finished" podID="a9550fa8-e72c-497c-a538-1e9940677af1" containerID="4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc" exitCode=0 Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796142 2557 generic.go:356] "Generic (PLEG): container finished" podID="a9550fa8-e72c-497c-a538-1e9940677af1" containerID="a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf" exitCode=0 Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796150 2557 generic.go:356] "Generic (PLEG): container finished" podID="a9550fa8-e72c-497c-a538-1e9940677af1" containerID="ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db" exitCode=0 Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796157 2557 generic.go:356] "Generic (PLEG): container finished" podID="a9550fa8-e72c-497c-a538-1e9940677af1" containerID="80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813" exitCode=0 Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796197 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerDied","Data":"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d"} Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796211 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796275 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerDied","Data":"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30"} Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796302 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerDied","Data":"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc"} Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796327 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerDied","Data":"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf"} Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796334 2557 scope.go:117] "RemoveContainer" containerID="ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d" Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796351 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerDied","Data":"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db"} Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796373 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerDied","Data":"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813"} Jul 01 17:42:16.796576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.796399 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9550fa8-e72c-497c-a538-1e9940677af1","Type":"ContainerDied","Data":"fe7410d492999f1a3eb9471e4c1a8d200c9bf36354e753fc19afee626e3c039d"} Jul 01 17:42:16.806141 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.806125 2557 scope.go:117] "RemoveContainer" containerID="a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30" Jul 01 17:42:16.813428 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.813405 2557 scope.go:117] "RemoveContainer" containerID="4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc" Jul 01 17:42:16.821054 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.821035 2557 scope.go:117] "RemoveContainer" containerID="a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf" Jul 01 17:42:16.824940 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.824889 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:42:16.829695 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.829675 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:42:16.829890 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.829873 2557 scope.go:117] "RemoveContainer" containerID="ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db" Jul 01 17:42:16.838278 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.838262 2557 scope.go:117] "RemoveContainer" containerID="80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813" Jul 01 17:42:16.845752 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.845735 2557 scope.go:117] "RemoveContainer" containerID="1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df" Jul 01 17:42:16.852458 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.852437 2557 scope.go:117] "RemoveContainer" containerID="ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d" Jul 01 17:42:16.852809 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:42:16.852775 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": container with ID starting with ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d not found: ID does not exist" containerID="ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d" Jul 01 17:42:16.852917 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.852817 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d"} err="failed to get container status \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": rpc error: code = NotFound desc = could not find container \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": container with ID starting with ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d not found: ID does not exist" Jul 01 17:42:16.852917 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.852850 2557 scope.go:117] "RemoveContainer" containerID="a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30" Jul 01 17:42:16.853154 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:42:16.853129 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": container with ID starting with a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30 not found: ID does not exist" containerID="a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30" Jul 01 17:42:16.853250 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.853160 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30"} err="failed to get container status \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": rpc error: code = NotFound desc = could not find container \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": container with ID starting with a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30 not found: ID does not exist" Jul 01 17:42:16.853250 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.853203 2557 scope.go:117] "RemoveContainer" containerID="4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc" Jul 01 17:42:16.853482 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:42:16.853455 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": container with ID starting with 4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc not found: ID does not exist" containerID="4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc" Jul 01 17:42:16.853552 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.853480 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc"} err="failed to get container status \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": rpc error: code = NotFound desc = could not find container \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": container with ID starting with 4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc not found: ID does not exist" Jul 01 17:42:16.853552 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.853497 2557 scope.go:117] "RemoveContainer" containerID="a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf" Jul 01 17:42:16.853738 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:42:16.853722 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": container with ID starting with a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf not found: ID does not exist" containerID="a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf" Jul 01 17:42:16.853776 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.853744 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf"} err="failed to get container status \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": rpc error: code = NotFound desc = could not find container \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": container with ID starting with a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf not found: ID does not exist" Jul 01 17:42:16.853776 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.853758 2557 scope.go:117] "RemoveContainer" containerID="ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db" Jul 01 17:42:16.854005 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:42:16.853989 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": container with ID starting with ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db not found: ID does not exist" containerID="ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db" Jul 01 17:42:16.854049 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.854009 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db"} err="failed to get container status \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": rpc error: code = NotFound desc = could not find container \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": container with ID starting with ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db not found: ID does not exist" Jul 01 17:42:16.854049 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.854026 2557 scope.go:117] "RemoveContainer" containerID="80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813" Jul 01 17:42:16.854277 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:42:16.854260 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": container with ID starting with 80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813 not found: ID does not exist" containerID="80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813" Jul 01 17:42:16.854338 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.854286 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813"} err="failed to get container status \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": rpc error: code = NotFound desc = could not find container \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": container with ID starting with 80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813 not found: ID does not exist" Jul 01 17:42:16.854338 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.854307 2557 scope.go:117] "RemoveContainer" containerID="1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df" Jul 01 17:42:16.854523 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:42:16.854507 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": container with ID starting with 1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df not found: ID does not exist" containerID="1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df" Jul 01 17:42:16.854563 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.854528 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df"} err="failed to get container status \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": rpc error: code = NotFound desc = could not find container \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": container with ID starting with 1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df not found: ID does not exist" Jul 01 17:42:16.854563 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.854542 2557 scope.go:117] "RemoveContainer" containerID="ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d" Jul 01 17:42:16.854785 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.854769 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d"} err="failed to get container status \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": rpc error: code = NotFound desc = could not find container \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": container with ID starting with ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d not found: ID does not exist" Jul 01 17:42:16.854785 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.854784 2557 scope.go:117] "RemoveContainer" containerID="a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30" Jul 01 17:42:16.854995 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.854975 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30"} err="failed to get container status \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": rpc error: code = NotFound desc = could not find container \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": container with ID starting with a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30 not found: ID does not exist" Jul 01 17:42:16.855037 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.854997 2557 scope.go:117] "RemoveContainer" containerID="4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc" Jul 01 17:42:16.855213 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.855190 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc"} err="failed to get container status \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": rpc error: code = NotFound desc = could not find container \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": container with ID starting with 4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc not found: ID does not exist" Jul 01 17:42:16.855263 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.855214 2557 scope.go:117] "RemoveContainer" containerID="a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf" Jul 01 17:42:16.855412 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.855393 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf"} err="failed to get container status \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": rpc error: code = NotFound desc = could not find container \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": container with ID starting with a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf not found: ID does not exist" Jul 01 17:42:16.855454 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.855414 2557 scope.go:117] "RemoveContainer" containerID="ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db" Jul 01 17:42:16.855616 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.855600 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db"} err="failed to get container status \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": rpc error: code = NotFound desc = could not find container \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": container with ID starting with ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db not found: ID does not exist" Jul 01 17:42:16.855690 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.855617 2557 scope.go:117] "RemoveContainer" containerID="80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813" Jul 01 17:42:16.855855 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.855837 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813"} err="failed to get container status \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": rpc error: code = NotFound desc = could not find container \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": container with ID starting with 80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813 not found: ID does not exist" Jul 01 17:42:16.855895 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.855855 2557 scope.go:117] "RemoveContainer" containerID="1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df" Jul 01 17:42:16.856076 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.856060 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df"} err="failed to get container status \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": rpc error: code = NotFound desc = could not find container \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": container with ID starting with 1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df not found: ID does not exist" Jul 01 17:42:16.856120 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.856077 2557 scope.go:117] "RemoveContainer" containerID="ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d" Jul 01 17:42:16.856281 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.856264 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d"} err="failed to get container status \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": rpc error: code = NotFound desc = could not find container \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": container with ID starting with ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d not found: ID does not exist" Jul 01 17:42:16.856327 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.856281 2557 scope.go:117] "RemoveContainer" containerID="a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30" Jul 01 17:42:16.856476 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.856455 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30"} err="failed to get container status \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": rpc error: code = NotFound desc = could not find container \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": container with ID starting with a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30 not found: ID does not exist" Jul 01 17:42:16.856476 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.856472 2557 scope.go:117] "RemoveContainer" containerID="4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc" Jul 01 17:42:16.856698 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.856678 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc"} err="failed to get container status \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": rpc error: code = NotFound desc = could not find container \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": container with ID starting with 4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc not found: ID does not exist" Jul 01 17:42:16.856774 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.856700 2557 scope.go:117] "RemoveContainer" containerID="a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf" Jul 01 17:42:16.856929 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.856913 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf"} err="failed to get container status \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": rpc error: code = NotFound desc = could not find container \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": container with ID starting with a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf not found: ID does not exist" Jul 01 17:42:16.856980 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.856929 2557 scope.go:117] "RemoveContainer" containerID="ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db" Jul 01 17:42:16.857163 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.857145 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db"} err="failed to get container status \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": rpc error: code = NotFound desc = could not find container \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": container with ID starting with ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db not found: ID does not exist" Jul 01 17:42:16.857228 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.857163 2557 scope.go:117] "RemoveContainer" containerID="80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813" Jul 01 17:42:16.857357 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.857342 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813"} err="failed to get container status \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": rpc error: code = NotFound desc = could not find container \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": container with ID starting with 80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813 not found: ID does not exist" Jul 01 17:42:16.857399 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.857357 2557 scope.go:117] "RemoveContainer" containerID="1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df" Jul 01 17:42:16.857550 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.857529 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df"} err="failed to get container status \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": rpc error: code = NotFound desc = could not find container \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": container with ID starting with 1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df not found: ID does not exist" Jul 01 17:42:16.857591 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.857550 2557 scope.go:117] "RemoveContainer" containerID="ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d" Jul 01 17:42:16.857782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.857762 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d"} err="failed to get container status \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": rpc error: code = NotFound desc = could not find container \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": container with ID starting with ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d not found: ID does not exist" Jul 01 17:42:16.857782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.857781 2557 scope.go:117] "RemoveContainer" containerID="a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30" Jul 01 17:42:16.857981 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.857963 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30"} err="failed to get container status \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": rpc error: code = NotFound desc = could not find container \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": container with ID starting with a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30 not found: ID does not exist" Jul 01 17:42:16.858026 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.857981 2557 scope.go:117] "RemoveContainer" containerID="4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc" Jul 01 17:42:16.858145 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.858129 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc"} err="failed to get container status \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": rpc error: code = NotFound desc = could not find container \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": container with ID starting with 4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc not found: ID does not exist" Jul 01 17:42:16.858200 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.858146 2557 scope.go:117] "RemoveContainer" containerID="a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf" Jul 01 17:42:16.858312 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.858297 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf"} err="failed to get container status \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": rpc error: code = NotFound desc = could not find container \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": container with ID starting with a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf not found: ID does not exist" Jul 01 17:42:16.858350 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.858312 2557 scope.go:117] "RemoveContainer" containerID="ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db" Jul 01 17:42:16.858536 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.858519 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db"} err="failed to get container status \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": rpc error: code = NotFound desc = could not find container \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": container with ID starting with ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db not found: ID does not exist" Jul 01 17:42:16.858536 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.858535 2557 scope.go:117] "RemoveContainer" containerID="80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813" Jul 01 17:42:16.858707 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.858691 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813"} err="failed to get container status \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": rpc error: code = NotFound desc = could not find container \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": container with ID starting with 80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813 not found: ID does not exist" Jul 01 17:42:16.858754 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.858707 2557 scope.go:117] "RemoveContainer" containerID="1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df" Jul 01 17:42:16.858924 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.858908 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df"} err="failed to get container status \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": rpc error: code = NotFound desc = could not find container \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": container with ID starting with 1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df not found: ID does not exist" Jul 01 17:42:16.858963 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.858924 2557 scope.go:117] "RemoveContainer" containerID="ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d" Jul 01 17:42:16.859123 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859107 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d"} err="failed to get container status \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": rpc error: code = NotFound desc = could not find container \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": container with ID starting with ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d not found: ID does not exist" Jul 01 17:42:16.859180 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859124 2557 scope.go:117] "RemoveContainer" containerID="a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30" Jul 01 17:42:16.859307 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859291 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30"} err="failed to get container status \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": rpc error: code = NotFound desc = could not find container \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": container with ID starting with a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30 not found: ID does not exist" Jul 01 17:42:16.859354 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859309 2557 scope.go:117] "RemoveContainer" containerID="4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc" Jul 01 17:42:16.859484 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859466 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc"} err="failed to get container status \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": rpc error: code = NotFound desc = could not find container \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": container with ID starting with 4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc not found: ID does not exist" Jul 01 17:42:16.859529 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859486 2557 scope.go:117] "RemoveContainer" containerID="a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf" Jul 01 17:42:16.859667 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859634 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf"} err="failed to get container status \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": rpc error: code = NotFound desc = could not find container \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": container with ID starting with a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf not found: ID does not exist" Jul 01 17:42:16.859716 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859667 2557 scope.go:117] "RemoveContainer" containerID="ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db" Jul 01 17:42:16.859841 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859822 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db"} err="failed to get container status \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": rpc error: code = NotFound desc = could not find container \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": container with ID starting with ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db not found: ID does not exist" Jul 01 17:42:16.859888 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859842 2557 scope.go:117] "RemoveContainer" containerID="80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813" Jul 01 17:42:16.860005 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.859990 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813"} err="failed to get container status \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": rpc error: code = NotFound desc = could not find container \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": container with ID starting with 80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813 not found: ID does not exist" Jul 01 17:42:16.860046 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860005 2557 scope.go:117] "RemoveContainer" containerID="1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df" Jul 01 17:42:16.860157 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860142 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df"} err="failed to get container status \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": rpc error: code = NotFound desc = could not find container \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": container with ID starting with 1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df not found: ID does not exist" Jul 01 17:42:16.860199 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860156 2557 scope.go:117] "RemoveContainer" containerID="ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d" Jul 01 17:42:16.860319 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860305 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d"} err="failed to get container status \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": rpc error: code = NotFound desc = could not find container \"ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d\": container with ID starting with ba537f6cf7587750d71b68ec321f5f8f61e44eef6793b8bce6e657895785387d not found: ID does not exist" Jul 01 17:42:16.860359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860319 2557 scope.go:117] "RemoveContainer" containerID="a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30" Jul 01 17:42:16.860482 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860462 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30"} err="failed to get container status \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": rpc error: code = NotFound desc = could not find container \"a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30\": container with ID starting with a07fc63f444a8f8c5c6edb2e08c0d98bfd5dfc878b600dad7dc940253189ea30 not found: ID does not exist" Jul 01 17:42:16.860522 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860483 2557 scope.go:117] "RemoveContainer" containerID="4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc" Jul 01 17:42:16.860667 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860636 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc"} err="failed to get container status \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": rpc error: code = NotFound desc = could not find container \"4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc\": container with ID starting with 4416a6130bf4d3cb81aa883a770f74520241cbcf26cf7940c45168d3045721fc not found: ID does not exist" Jul 01 17:42:16.860714 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860668 2557 scope.go:117] "RemoveContainer" containerID="a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf" Jul 01 17:42:16.860925 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860901 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf"} err="failed to get container status \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": rpc error: code = NotFound desc = could not find container \"a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf\": container with ID starting with a63c9f9e43b8cde3d8d1029b9e344cffa820d8ef6cb733ee2d9e9bc3d3691eaf not found: ID does not exist" Jul 01 17:42:16.860925 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.860922 2557 scope.go:117] "RemoveContainer" containerID="ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db" Jul 01 17:42:16.861195 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.861175 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db"} err="failed to get container status \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": rpc error: code = NotFound desc = could not find container \"ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db\": container with ID starting with ddaaa4d2e291ec9a2499d3bee0a2dac004e19f2591f224d2fda44d794869f6db not found: ID does not exist" Jul 01 17:42:16.861195 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.861194 2557 scope.go:117] "RemoveContainer" containerID="80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813" Jul 01 17:42:16.861511 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.861494 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813"} err="failed to get container status \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": rpc error: code = NotFound desc = could not find container \"80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813\": container with ID starting with 80ef8ea9bd0c22d07cee2700884e9133fca5350dbb4ccad464c1bc9cc88db813 not found: ID does not exist" Jul 01 17:42:16.861584 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.861512 2557 scope.go:117] "RemoveContainer" containerID="1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df" Jul 01 17:42:16.861800 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.861783 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df"} err="failed to get container status \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": rpc error: code = NotFound desc = could not find container \"1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df\": container with ID starting with 1f593250e42286db2a65bb21959ec507563196f0c79dcb73d11b8056b1d009df not found: ID does not exist" Jul 01 17:42:16.863084 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863065 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:42:16.863344 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863333 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="init-config-reloader" Jul 01 17:42:16.863387 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863346 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="init-config-reloader" Jul 01 17:42:16.863387 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863361 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy" Jul 01 17:42:16.863387 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863366 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy" Jul 01 17:42:16.863387 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863372 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="prometheus" Jul 01 17:42:16.863387 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863377 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="prometheus" Jul 01 17:42:16.863387 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863384 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="thanos-sidecar" Jul 01 17:42:16.863387 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863389 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="thanos-sidecar" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863399 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy-thanos" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863404 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy-thanos" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863413 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy-web" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863418 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy-web" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863425 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="config-reloader" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863429 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="config-reloader" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863474 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy-web" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863483 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy-thanos" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863489 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="kube-rbac-proxy" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863495 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="prometheus" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863500 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="config-reloader" Jul 01 17:42:16.863617 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.863505 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" containerName="thanos-sidecar" Jul 01 17:42:16.868684 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.868667 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.871735 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.871716 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 17:42:16.872012 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.871999 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 17:42:16.872050 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.872001 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 17:42:16.872258 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.872240 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 17:42:16.872309 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.872243 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 17:42:16.872473 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.872456 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jt6jn\"" Jul 01 17:42:16.872798 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.872782 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 17:42:16.872846 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.872782 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 17:42:16.872887 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.872784 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 17:42:16.874017 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.873995 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 17:42:16.874147 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.874025 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 17:42:16.874147 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.874041 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 17:42:16.874147 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.874057 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 17:42:16.874421 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.874152 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aq1h6uj80kf89\"" Jul 01 17:42:16.874905 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.874886 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 17:42:16.877017 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.876997 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 17:42:16.878593 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.878576 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 17:42:16.890365 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.890344 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:42:16.986886 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.986856 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3a42b7c-bdff-4516-9232-954a72b35958-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.986886 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.986892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987077 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.986913 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987077 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.986936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987077 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.986967 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987077 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.986986 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987077 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987003 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987077 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987018 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987077 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987300 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987092 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987300 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987123 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987300 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987152 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3a42b7c-bdff-4516-9232-954a72b35958-config-out\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987300 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987167 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-web-config\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987300 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987188 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987300 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987218 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987300 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987235 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987300 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987250 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-config\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987300 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987280 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987552 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987307 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:16.987552 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:16.987321 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkbgn\" (UniqueName: \"kubernetes.io/projected/b3a42b7c-bdff-4516-9232-954a72b35958-kube-api-access-jkbgn\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088543 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088445 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088543 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088511 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088543 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088537 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkbgn\" (UniqueName: \"kubernetes.io/projected/b3a42b7c-bdff-4516-9232-954a72b35958-kube-api-access-jkbgn\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088577 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3a42b7c-bdff-4516-9232-954a72b35958-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088607 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088638 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088687 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088716 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088744 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088770 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088792 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088819 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.088857 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088842 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.089359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088870 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.089359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088922 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3a42b7c-bdff-4516-9232-954a72b35958-config-out\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.089359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088964 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-web-config\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.089359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.088999 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.089359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.089031 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.089359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.089059 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.089359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.089085 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-config\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.089359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.089341 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.089778 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.089380 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.089778 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.089395 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.090176 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.090152 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.092467 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.092144 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.092467 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.092263 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-web-config\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.092467 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.092269 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.092703 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.092485 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.092766 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.092725 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3a42b7c-bdff-4516-9232-954a72b35958-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.093317 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.093279 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.093432 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.093413 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.093497 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.093436 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.093991 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.093690 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3a42b7c-bdff-4516-9232-954a72b35958-config-out\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.093991 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.093952 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-config\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.094170 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.094146 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.094809 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.094784 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.094903 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.094849 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.095359 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.095338 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b3a42b7c-bdff-4516-9232-954a72b35958-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.095542 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.095525 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3a42b7c-bdff-4516-9232-954a72b35958-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.101145 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.101123 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkbgn\" (UniqueName: \"kubernetes.io/projected/b3a42b7c-bdff-4516-9232-954a72b35958-kube-api-access-jkbgn\") pod \"prometheus-k8s-0\" (UID: \"b3a42b7c-bdff-4516-9232-954a72b35958\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.178202 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.178170 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:42:17.345454 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.345430 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:42:17.347915 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:42:17.347885 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a42b7c_bdff_4516_9232_954a72b35958.slice/crio-b06c851afa453968d83eb9d6274e314fdc76b67550137dfd3e766329a6c512bb WatchSource:0}: Error finding container b06c851afa453968d83eb9d6274e314fdc76b67550137dfd3e766329a6c512bb: Status 404 returned error can't find the container with id b06c851afa453968d83eb9d6274e314fdc76b67550137dfd3e766329a6c512bb Jul 01 17:42:17.803401 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.803369 2557 generic.go:356] "Generic (PLEG): container finished" podID="b3a42b7c-bdff-4516-9232-954a72b35958" containerID="c1a60e580a0089f28a020fb48a803fcca240b283e7e2389f5f223686083c4a4c" exitCode=0 Jul 01 17:42:17.803796 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.803412 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3a42b7c-bdff-4516-9232-954a72b35958","Type":"ContainerDied","Data":"c1a60e580a0089f28a020fb48a803fcca240b283e7e2389f5f223686083c4a4c"} Jul 01 17:42:17.803796 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.803462 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3a42b7c-bdff-4516-9232-954a72b35958","Type":"ContainerStarted","Data":"b06c851afa453968d83eb9d6274e314fdc76b67550137dfd3e766329a6c512bb"} Jul 01 17:42:17.915730 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:17.915699 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9550fa8-e72c-497c-a538-1e9940677af1" path="/var/lib/kubelet/pods/a9550fa8-e72c-497c-a538-1e9940677af1/volumes" Jul 01 17:42:18.816527 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:18.816488 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3a42b7c-bdff-4516-9232-954a72b35958","Type":"ContainerStarted","Data":"7ed3583398f43da1494c84aa27c7a635077655b86a6ff58c2a0946c7aa419182"} Jul 01 17:42:18.816963 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:18.816601 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3a42b7c-bdff-4516-9232-954a72b35958","Type":"ContainerStarted","Data":"6059fa73dcb2e3d828350640dd13dae8246e4241bbb98530d847b22851ab43e7"} Jul 01 17:42:18.816963 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:18.816664 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3a42b7c-bdff-4516-9232-954a72b35958","Type":"ContainerStarted","Data":"b55566c523812871cd5ed2d49ee6c95d299fe988bfe5af53d133a7405d9eb1dd"} Jul 01 17:42:18.816963 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:18.816703 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3a42b7c-bdff-4516-9232-954a72b35958","Type":"ContainerStarted","Data":"ab9185cf205483c68a6d808378f17fdc268b4aae0bbf7532c42c3281a0085f48"} Jul 01 17:42:18.816963 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:18.816744 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3a42b7c-bdff-4516-9232-954a72b35958","Type":"ContainerStarted","Data":"4d8a09694afc813205d032878f556add4ba9ed879c7b27f2a545632877fc3cf8"} Jul 01 17:42:18.816963 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:18.816781 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3a42b7c-bdff-4516-9232-954a72b35958","Type":"ContainerStarted","Data":"a8dd7626cadaa7ebbb456c852501a905680dbf51a10196ea7a6083d9141cd385"} Jul 01 17:42:18.849355 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:18.849308 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.826812194 podStartE2EDuration="2.849287466s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.475272ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:42:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:42:18.846590413 +0000 UTC m=+191.354242045" watchObservedRunningTime="2026-07-01 17:42:18.849287466 +0000 UTC m=+191.356939075" Jul 01 17:42:22.178481 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:42:22.178446 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:43:17.178882 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:43:17.178847 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:43:17.193716 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:43:17.193694 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:43:18.056418 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:43:18.056391 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:44:07.848573 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:44:07.848543 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4tzt_4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2/ovn-acl-logging/0.log" Jul 01 17:44:07.856111 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:44:07.856090 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4tzt_4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2/ovn-acl-logging/0.log" Jul 01 17:44:07.857682 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:44:07.857636 2557 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 17:45:04.967972 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:04.967887 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9"] Jul 01 17:45:04.971261 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:04.971246 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:04.981449 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:04.981427 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 17:45:04.982138 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:04.982123 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 17:45:04.982221 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:04.982204 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 17:45:04.982384 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:04.982368 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 17:45:04.986990 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:04.986975 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xz94q\"" Jul 01 17:45:05.027841 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.027802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0be5f807-c132-467a-b72b-5ed763647adc-tmp\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.028001 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.027858 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5qfp\" (UniqueName: \"kubernetes.io/projected/0be5f807-c132-467a-b72b-5ed763647adc-kube-api-access-z5qfp\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.028001 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.027878 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0be5f807-c132-467a-b72b-5ed763647adc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.028001 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.027901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0be5f807-c132-467a-b72b-5ed763647adc-manifests\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.028001 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.027918 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0be5f807-c132-467a-b72b-5ed763647adc-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.070019 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.069988 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9"] Jul 01 17:45:05.128625 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.128584 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0be5f807-c132-467a-b72b-5ed763647adc-tmp\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.128824 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.128635 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5qfp\" (UniqueName: \"kubernetes.io/projected/0be5f807-c132-467a-b72b-5ed763647adc-kube-api-access-z5qfp\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.128824 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.128669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0be5f807-c132-467a-b72b-5ed763647adc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.128824 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.128692 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0be5f807-c132-467a-b72b-5ed763647adc-manifests\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.128824 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.128720 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0be5f807-c132-467a-b72b-5ed763647adc-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.129103 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.129083 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0be5f807-c132-467a-b72b-5ed763647adc-manifests\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.131124 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.131101 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0be5f807-c132-467a-b72b-5ed763647adc-tmp\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.131376 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.131359 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0be5f807-c132-467a-b72b-5ed763647adc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.131438 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.131416 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0be5f807-c132-467a-b72b-5ed763647adc-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.164852 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.164817 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5qfp\" (UniqueName: \"kubernetes.io/projected/0be5f807-c132-467a-b72b-5ed763647adc-kube-api-access-z5qfp\") pod \"opendatahub-operator-controller-manager-66c9b6b59-fwnx9\" (UID: \"0be5f807-c132-467a-b72b-5ed763647adc\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.281005 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.280922 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:05.511676 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:45:05.511635 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be5f807_c132_467a_b72b_5ed763647adc.slice/crio-362de3ca0796ad4cd66440ac7434eab8869611249f7862a4681235e31627c445 WatchSource:0}: Error finding container 362de3ca0796ad4cd66440ac7434eab8869611249f7862a4681235e31627c445: Status 404 returned error can't find the container with id 362de3ca0796ad4cd66440ac7434eab8869611249f7862a4681235e31627c445 Jul 01 17:45:05.513407 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.513388 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:45:05.516046 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:05.516021 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9"] Jul 01 17:45:06.451481 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:06.451435 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" event={"ID":"0be5f807-c132-467a-b72b-5ed763647adc","Type":"ContainerStarted","Data":"362de3ca0796ad4cd66440ac7434eab8869611249f7862a4681235e31627c445"} Jul 01 17:45:09.466052 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:09.466017 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" event={"ID":"0be5f807-c132-467a-b72b-5ed763647adc","Type":"ContainerStarted","Data":"612f752c4173e9fbb4eb14b3cbb9362985128759c2c1a9818e17ec0f2d6bf9ca"} Jul 01 17:45:10.471172 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:10.471140 2557 generic.go:356] "Generic (PLEG): container finished" podID="0be5f807-c132-467a-b72b-5ed763647adc" containerID="612f752c4173e9fbb4eb14b3cbb9362985128759c2c1a9818e17ec0f2d6bf9ca" exitCode=0 Jul 01 17:45:10.471557 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:10.471178 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" event={"ID":"0be5f807-c132-467a-b72b-5ed763647adc","Type":"ContainerDied","Data":"612f752c4173e9fbb4eb14b3cbb9362985128759c2c1a9818e17ec0f2d6bf9ca"} Jul 01 17:45:11.478219 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:11.478188 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" event={"ID":"0be5f807-c132-467a-b72b-5ed763647adc","Type":"ContainerStarted","Data":"fa06a5edac9a2747134bff8d4695e8f8a6018a1c7aa18528cbb461a5f47e5539"} Jul 01 17:45:11.478592 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:11.478278 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:22.485484 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:22.485455 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" Jul 01 17:45:22.522793 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:22.521989 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-fwnx9" podStartSLOduration=13.93800019 podStartE2EDuration="18.521969467s" totalImagesPullingTime="3.637689504s" totalInitContainerRuntime="946.279773ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:45:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:45:11.537547713 +0000 UTC m=+364.045199322" watchObservedRunningTime="2026-07-01 17:45:22.521969467 +0000 UTC m=+375.029621077" Jul 01 17:45:34.836726 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.836694 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5"] Jul 01 17:45:34.840215 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.840193 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:34.844508 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.844465 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 17:45:34.844679 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.844513 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 17:45:34.844679 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.844472 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9l9s5\"" Jul 01 17:45:34.844679 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.844561 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:45:34.844679 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.844601 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 17:45:34.844679 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.844608 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 17:45:34.861717 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.861698 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5"] Jul 01 17:45:34.967662 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.967613 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7510f352-57e6-4760-8ce0-a1fb85df36b3-metrics-cert\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:34.967831 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.967791 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2h2z\" (UniqueName: \"kubernetes.io/projected/7510f352-57e6-4760-8ce0-a1fb85df36b3-kube-api-access-l2h2z\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:34.967894 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.967833 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7510f352-57e6-4760-8ce0-a1fb85df36b3-manager-config\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:34.967984 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:34.967958 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7510f352-57e6-4760-8ce0-a1fb85df36b3-cert\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:35.068576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.068543 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7510f352-57e6-4760-8ce0-a1fb85df36b3-metrics-cert\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:35.068788 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.068594 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2h2z\" (UniqueName: \"kubernetes.io/projected/7510f352-57e6-4760-8ce0-a1fb85df36b3-kube-api-access-l2h2z\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:35.068788 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.068619 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7510f352-57e6-4760-8ce0-a1fb85df36b3-manager-config\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:35.068788 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.068662 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7510f352-57e6-4760-8ce0-a1fb85df36b3-cert\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:35.069255 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.069232 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7510f352-57e6-4760-8ce0-a1fb85df36b3-manager-config\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:35.071316 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.071295 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7510f352-57e6-4760-8ce0-a1fb85df36b3-cert\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:35.071411 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.071331 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7510f352-57e6-4760-8ce0-a1fb85df36b3-metrics-cert\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:35.083479 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.083451 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2h2z\" (UniqueName: \"kubernetes.io/projected/7510f352-57e6-4760-8ce0-a1fb85df36b3-kube-api-access-l2h2z\") pod \"lws-controller-manager-6599c59cb5-k5dj5\" (UID: \"7510f352-57e6-4760-8ce0-a1fb85df36b3\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:35.149923 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.149901 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:35.470534 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.470512 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5"] Jul 01 17:45:35.473044 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:45:35.473014 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7510f352_57e6_4760_8ce0_a1fb85df36b3.slice/crio-2fe0664c5a9b04983959b0373c41d5a678f0080244e977981268ef5084e8699f WatchSource:0}: Error finding container 2fe0664c5a9b04983959b0373c41d5a678f0080244e977981268ef5084e8699f: Status 404 returned error can't find the container with id 2fe0664c5a9b04983959b0373c41d5a678f0080244e977981268ef5084e8699f Jul 01 17:45:35.585268 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:35.585231 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" event={"ID":"7510f352-57e6-4760-8ce0-a1fb85df36b3","Type":"ContainerStarted","Data":"2fe0664c5a9b04983959b0373c41d5a678f0080244e977981268ef5084e8699f"} Jul 01 17:45:37.788628 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.788592 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f"] Jul 01 17:45:37.792057 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.792037 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:37.801026 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.800863 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vrskt\"" Jul 01 17:45:37.801026 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.800961 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 17:45:37.801153 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.800863 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 17:45:37.824809 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.824786 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 17:45:37.826133 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.826111 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 17:45:37.892532 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.892493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410a9d39-c277-4056-ba45-ab345e66beda-tls-certs\") pod \"kube-auth-proxy-6647fbf6bf-4976f\" (UID: \"410a9d39-c277-4056-ba45-ab345e66beda\") " pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:37.892702 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.892542 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/410a9d39-c277-4056-ba45-ab345e66beda-tmp\") pod \"kube-auth-proxy-6647fbf6bf-4976f\" (UID: \"410a9d39-c277-4056-ba45-ab345e66beda\") " pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:37.892702 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.892589 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r975s\" (UniqueName: \"kubernetes.io/projected/410a9d39-c277-4056-ba45-ab345e66beda-kube-api-access-r975s\") pod \"kube-auth-proxy-6647fbf6bf-4976f\" (UID: \"410a9d39-c277-4056-ba45-ab345e66beda\") " pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:37.933475 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.933447 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f"] Jul 01 17:45:37.993020 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.992991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r975s\" (UniqueName: \"kubernetes.io/projected/410a9d39-c277-4056-ba45-ab345e66beda-kube-api-access-r975s\") pod \"kube-auth-proxy-6647fbf6bf-4976f\" (UID: \"410a9d39-c277-4056-ba45-ab345e66beda\") " pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:37.993176 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.993117 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410a9d39-c277-4056-ba45-ab345e66beda-tls-certs\") pod \"kube-auth-proxy-6647fbf6bf-4976f\" (UID: \"410a9d39-c277-4056-ba45-ab345e66beda\") " pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:37.993176 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.993139 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/410a9d39-c277-4056-ba45-ab345e66beda-tmp\") pod \"kube-auth-proxy-6647fbf6bf-4976f\" (UID: \"410a9d39-c277-4056-ba45-ab345e66beda\") " pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:37.996283 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.996254 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410a9d39-c277-4056-ba45-ab345e66beda-tls-certs\") pod \"kube-auth-proxy-6647fbf6bf-4976f\" (UID: \"410a9d39-c277-4056-ba45-ab345e66beda\") " pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:37.996400 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:37.996343 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/410a9d39-c277-4056-ba45-ab345e66beda-tmp\") pod \"kube-auth-proxy-6647fbf6bf-4976f\" (UID: \"410a9d39-c277-4056-ba45-ab345e66beda\") " pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:38.014239 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:38.014211 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r975s\" (UniqueName: \"kubernetes.io/projected/410a9d39-c277-4056-ba45-ab345e66beda-kube-api-access-r975s\") pod \"kube-auth-proxy-6647fbf6bf-4976f\" (UID: \"410a9d39-c277-4056-ba45-ab345e66beda\") " pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:38.105121 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:38.105096 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" Jul 01 17:45:38.381963 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:38.381881 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f"] Jul 01 17:45:39.026685 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:45:39.026639 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod410a9d39_c277_4056_ba45_ab345e66beda.slice/crio-6a54f095e3239b7fc0427e7a1896c182b5bbd02c742e26959faf8bf0360e8548 WatchSource:0}: Error finding container 6a54f095e3239b7fc0427e7a1896c182b5bbd02c742e26959faf8bf0360e8548: Status 404 returned error can't find the container with id 6a54f095e3239b7fc0427e7a1896c182b5bbd02c742e26959faf8bf0360e8548 Jul 01 17:45:39.605207 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:39.605155 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" event={"ID":"410a9d39-c277-4056-ba45-ab345e66beda","Type":"ContainerStarted","Data":"6a54f095e3239b7fc0427e7a1896c182b5bbd02c742e26959faf8bf0360e8548"} Jul 01 17:45:39.606799 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:39.606767 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" event={"ID":"7510f352-57e6-4760-8ce0-a1fb85df36b3","Type":"ContainerStarted","Data":"962554b15a5fc59992026a5eb9688759dc4d58a04a4ad4f17a60add252463160"} Jul 01 17:45:39.606940 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:39.606921 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:45:39.697777 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:39.697584 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" podStartSLOduration=1.7352527370000002 podStartE2EDuration="5.697562539s" totalImagesPullingTime="3.962309802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:45:39.695156592 +0000 UTC m=+392.202808200" watchObservedRunningTime="2026-07-01 17:45:39.697562539 +0000 UTC m=+392.205214147" Jul 01 17:45:41.616536 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:41.616496 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" event={"ID":"410a9d39-c277-4056-ba45-ab345e66beda","Type":"ContainerStarted","Data":"eac93974c548d9de173366ad42f2de3904e5934d022a84aa07ee0452ad4d9a8f"} Jul 01 17:45:41.709694 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:41.709587 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6647fbf6bf-4976f" podStartSLOduration=2.3166437269999998 podStartE2EDuration="4.709570826s" totalImagesPullingTime="2.392927099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:45:41.703212169 +0000 UTC m=+394.210863778" watchObservedRunningTime="2026-07-01 17:45:41.709570826 +0000 UTC m=+394.217222434" Jul 01 17:45:50.613911 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:45:50.613877 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-k5dj5" Jul 01 17:47:10.881031 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:10.881001 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz"] Jul 01 17:47:10.884234 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:10.884215 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" Jul 01 17:47:10.892823 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:47:10.892795 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"dns-operator-controller-env\" is forbidden: User \"system:node:ip-10-0-140-89.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-89.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" type="*v1.ConfigMap" Jul 01 17:47:10.892823 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:47:10.892795 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-89.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-89.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 01 17:47:10.892957 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:47:10.892796 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-operator-controller-manager-dockercfg-wzk4d\" is forbidden: User \"system:node:ip-10-0-140-89.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-89.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wzk4d\"" type="*v1.Secret" Jul 01 17:47:10.893283 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:47:10.893252 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"dns-operator-controller-manager-864dd78c4c-79wzz\" is forbidden: User \"system:node:ip-10-0-140-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-89.ec2.internal' and this object" podUID="13cac9fa-c64c-4dd3-8059-af99ec0ef7d1" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" Jul 01 17:47:10.893373 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:47:10.893354 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-89.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-89.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 01 17:47:10.938901 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:10.938869 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz"] Jul 01 17:47:10.974059 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:10.974028 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgnvs\" (UniqueName: \"kubernetes.io/projected/13cac9fa-c64c-4dd3-8059-af99ec0ef7d1-kube-api-access-pgnvs\") pod \"dns-operator-controller-manager-864dd78c4c-79wzz\" (UID: \"13cac9fa-c64c-4dd3-8059-af99ec0ef7d1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" Jul 01 17:47:11.074477 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:11.074437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgnvs\" (UniqueName: \"kubernetes.io/projected/13cac9fa-c64c-4dd3-8059-af99ec0ef7d1-kube-api-access-pgnvs\") pod \"dns-operator-controller-manager-864dd78c4c-79wzz\" (UID: \"13cac9fa-c64c-4dd3-8059-af99ec0ef7d1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" Jul 01 17:47:11.702184 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:11.702153 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 17:47:11.781047 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:11.781019 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 17:47:11.793159 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:11.793134 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgnvs\" (UniqueName: \"kubernetes.io/projected/13cac9fa-c64c-4dd3-8059-af99ec0ef7d1-kube-api-access-pgnvs\") pod \"dns-operator-controller-manager-864dd78c4c-79wzz\" (UID: \"13cac9fa-c64c-4dd3-8059-af99ec0ef7d1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" Jul 01 17:47:11.845801 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:11.845762 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wzk4d\"" Jul 01 17:47:11.854881 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:11.854855 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" Jul 01 17:47:12.072522 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:12.072496 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz"] Jul 01 17:47:12.074180 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:47:12.074152 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13cac9fa_c64c_4dd3_8059_af99ec0ef7d1.slice/crio-d792b298fe9819911fb6d860cacffaf503564a20cedfc712500b115afec595cb WatchSource:0}: Error finding container d792b298fe9819911fb6d860cacffaf503564a20cedfc712500b115afec595cb: Status 404 returned error can't find the container with id d792b298fe9819911fb6d860cacffaf503564a20cedfc712500b115afec595cb Jul 01 17:47:12.158234 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:12.158201 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 17:47:13.002332 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:13.002290 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" event={"ID":"13cac9fa-c64c-4dd3-8059-af99ec0ef7d1","Type":"ContainerStarted","Data":"d792b298fe9819911fb6d860cacffaf503564a20cedfc712500b115afec595cb"} Jul 01 17:47:15.451494 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:15.451461 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-khpfc"] Jul 01 17:47:15.454847 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:15.454831 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khpfc" Jul 01 17:47:15.459023 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:15.459000 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8qgs9\"" Jul 01 17:47:15.491966 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:15.489231 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-khpfc"] Jul 01 17:47:15.513135 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:15.513097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khhhn\" (UniqueName: \"kubernetes.io/projected/b999f861-65be-45b4-8d7e-f0d1a44dbdad-kube-api-access-khhhn\") pod \"authorino-operator-75cc8d5cb7-khpfc\" (UID: \"b999f861-65be-45b4-8d7e-f0d1a44dbdad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-khpfc" Jul 01 17:47:15.613775 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:15.613744 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khhhn\" (UniqueName: \"kubernetes.io/projected/b999f861-65be-45b4-8d7e-f0d1a44dbdad-kube-api-access-khhhn\") pod \"authorino-operator-75cc8d5cb7-khpfc\" (UID: \"b999f861-65be-45b4-8d7e-f0d1a44dbdad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-khpfc" Jul 01 17:47:15.629630 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:15.629595 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khhhn\" (UniqueName: \"kubernetes.io/projected/b999f861-65be-45b4-8d7e-f0d1a44dbdad-kube-api-access-khhhn\") pod \"authorino-operator-75cc8d5cb7-khpfc\" (UID: \"b999f861-65be-45b4-8d7e-f0d1a44dbdad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-khpfc" Jul 01 17:47:15.765494 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:15.765451 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khpfc" Jul 01 17:47:15.931530 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:15.931507 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-khpfc"] Jul 01 17:47:15.933283 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:47:15.933255 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb999f861_65be_45b4_8d7e_f0d1a44dbdad.slice/crio-fc7c98b9bcca2f854d6cdd04d78459e170a054fd050b0cb6b3c4ace0c6974235 WatchSource:0}: Error finding container fc7c98b9bcca2f854d6cdd04d78459e170a054fd050b0cb6b3c4ace0c6974235: Status 404 returned error can't find the container with id fc7c98b9bcca2f854d6cdd04d78459e170a054fd050b0cb6b3c4ace0c6974235 Jul 01 17:47:16.019353 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:16.019318 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" event={"ID":"13cac9fa-c64c-4dd3-8059-af99ec0ef7d1","Type":"ContainerStarted","Data":"ff74437ef9b252f796dc38d8fe9da535de1a9905486ebb1025702dd71f0ce8cb"} Jul 01 17:47:16.019546 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:16.019481 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" Jul 01 17:47:16.020531 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:16.020511 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khpfc" event={"ID":"b999f861-65be-45b4-8d7e-f0d1a44dbdad","Type":"ContainerStarted","Data":"fc7c98b9bcca2f854d6cdd04d78459e170a054fd050b0cb6b3c4ace0c6974235"} Jul 01 17:47:16.056044 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:16.055990 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" podStartSLOduration=2.803177992 podStartE2EDuration="6.055976145s" totalImagesPullingTime="3.252798153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:16.054872159 +0000 UTC m=+488.562523767" watchObservedRunningTime="2026-07-01 17:47:16.055976145 +0000 UTC m=+488.563627753" Jul 01 17:47:19.035141 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:19.035102 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khpfc" event={"ID":"b999f861-65be-45b4-8d7e-f0d1a44dbdad","Type":"ContainerStarted","Data":"452e4fd6f9928154f3036a08d7ad31e6edbadf230370b0fb37ebf3357f6b69f6"} Jul 01 17:47:19.035636 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:19.035262 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khpfc" Jul 01 17:47:19.079994 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:19.079938 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khpfc" podStartSLOduration=1.123445649 podStartE2EDuration="4.079921666s" totalImagesPullingTime="2.956476017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:19.077083778 +0000 UTC m=+491.584735386" watchObservedRunningTime="2026-07-01 17:47:19.079921666 +0000 UTC m=+491.587573274" Jul 01 17:47:27.027166 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:27.027132 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-79wzz" Jul 01 17:47:30.041900 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:47:30.041872 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-khpfc" Jul 01 17:48:07.818846 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.818814 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:48:07.822140 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.822124 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" Jul 01 17:48:07.825492 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.825475 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 17:48:07.825631 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.825616 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hpjjm\"" Jul 01 17:48:07.841196 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.841169 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:48:07.860139 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.860112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmm8g\" (UniqueName: \"kubernetes.io/projected/eb2357e0-89d2-44e5-90aa-1779734bd4fc-kube-api-access-fmm8g\") pod \"limitador-limitador-54d6d988d5-9bs6v\" (UID: \"eb2357e0-89d2-44e5-90aa-1779734bd4fc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" Jul 01 17:48:07.860318 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.860273 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb2357e0-89d2-44e5-90aa-1779734bd4fc-config-file\") pod \"limitador-limitador-54d6d988d5-9bs6v\" (UID: \"eb2357e0-89d2-44e5-90aa-1779734bd4fc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" Jul 01 17:48:07.863993 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.863969 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:48:07.960860 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.960828 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmm8g\" (UniqueName: \"kubernetes.io/projected/eb2357e0-89d2-44e5-90aa-1779734bd4fc-kube-api-access-fmm8g\") pod \"limitador-limitador-54d6d988d5-9bs6v\" (UID: \"eb2357e0-89d2-44e5-90aa-1779734bd4fc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" Jul 01 17:48:07.961017 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.960970 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb2357e0-89d2-44e5-90aa-1779734bd4fc-config-file\") pod \"limitador-limitador-54d6d988d5-9bs6v\" (UID: \"eb2357e0-89d2-44e5-90aa-1779734bd4fc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" Jul 01 17:48:07.961576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.961554 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb2357e0-89d2-44e5-90aa-1779734bd4fc-config-file\") pod \"limitador-limitador-54d6d988d5-9bs6v\" (UID: \"eb2357e0-89d2-44e5-90aa-1779734bd4fc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" Jul 01 17:48:07.974283 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:07.974258 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmm8g\" (UniqueName: \"kubernetes.io/projected/eb2357e0-89d2-44e5-90aa-1779734bd4fc-kube-api-access-fmm8g\") pod \"limitador-limitador-54d6d988d5-9bs6v\" (UID: \"eb2357e0-89d2-44e5-90aa-1779734bd4fc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" Jul 01 17:48:08.132247 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:08.132226 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" Jul 01 17:48:08.282889 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:08.282868 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:48:08.284354 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:48:08.284324 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2357e0_89d2_44e5_90aa_1779734bd4fc.slice/crio-34151eebf0781f5cf36c825dc660ad49637238e437b19a7f7ae5895de474893f WatchSource:0}: Error finding container 34151eebf0781f5cf36c825dc660ad49637238e437b19a7f7ae5895de474893f: Status 404 returned error can't find the container with id 34151eebf0781f5cf36c825dc660ad49637238e437b19a7f7ae5895de474893f Jul 01 17:48:09.272791 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:09.272556 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" event={"ID":"eb2357e0-89d2-44e5-90aa-1779734bd4fc","Type":"ContainerStarted","Data":"34151eebf0781f5cf36c825dc660ad49637238e437b19a7f7ae5895de474893f"} Jul 01 17:48:11.284409 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:11.284368 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" event={"ID":"eb2357e0-89d2-44e5-90aa-1779734bd4fc","Type":"ContainerStarted","Data":"7d3b8d4dfbf094ffc91c789c38ed0c22d0b3288100e245b945f7a719f88f2ead"} Jul 01 17:48:11.284852 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:11.284491 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" Jul 01 17:48:11.328074 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:11.328008 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" podStartSLOduration=1.482168035 podStartE2EDuration="4.327993582s" totalImagesPullingTime="2.845825547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:11.327880009 +0000 UTC m=+543.835531617" watchObservedRunningTime="2026-07-01 17:48:11.327993582 +0000 UTC m=+543.835645226" Jul 01 17:48:22.289913 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:48:22.289885 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9bs6v" Jul 01 17:49:07.879625 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:49:07.879596 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4tzt_4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2/ovn-acl-logging/0.log" Jul 01 17:49:07.885135 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:49:07.885113 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4tzt_4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2/ovn-acl-logging/0.log" Jul 01 17:50:23.884712 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:50:23.884673 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:51:31.423044 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:31.423008 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:51:36.355352 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.355315 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-8jf55"] Jul 01 17:51:36.358787 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.358771 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.363842 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.363819 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 01 17:51:36.364327 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.364308 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 17:51:36.364919 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.364898 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 17:51:36.364919 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.364914 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8w6gd\"" Jul 01 17:51:36.389224 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.389199 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-8jf55"] Jul 01 17:51:36.416487 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.416458 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ef378e-1fb2-47fc-8487-21f647f58eae-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.416625 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.416581 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ef378e-1fb2-47fc-8487-21f647f58eae-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.416625 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.416612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ef378e-1fb2-47fc-8487-21f647f58eae-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.416752 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.416629 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjvvf\" (UniqueName: \"kubernetes.io/projected/32ef378e-1fb2-47fc-8487-21f647f58eae-kube-api-access-fjvvf\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.416752 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.416670 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ef378e-1fb2-47fc-8487-21f647f58eae-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.517237 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.517205 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ef378e-1fb2-47fc-8487-21f647f58eae-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.517417 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.517280 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ef378e-1fb2-47fc-8487-21f647f58eae-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.517417 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.517309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ef378e-1fb2-47fc-8487-21f647f58eae-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.517417 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.517330 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjvvf\" (UniqueName: \"kubernetes.io/projected/32ef378e-1fb2-47fc-8487-21f647f58eae-kube-api-access-fjvvf\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.517417 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.517359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ef378e-1fb2-47fc-8487-21f647f58eae-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.517694 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.517672 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ef378e-1fb2-47fc-8487-21f647f58eae-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.517786 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.517764 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ef378e-1fb2-47fc-8487-21f647f58eae-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.519661 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.519621 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ef378e-1fb2-47fc-8487-21f647f58eae-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.519865 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.519851 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ef378e-1fb2-47fc-8487-21f647f58eae-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.534128 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.534108 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjvvf\" (UniqueName: \"kubernetes.io/projected/32ef378e-1fb2-47fc-8487-21f647f58eae-kube-api-access-fjvvf\") pod \"e2e-distinct-simulated-kserve-ff95456df-8jf55\" (UID: \"32ef378e-1fb2-47fc-8487-21f647f58eae\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.669580 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.669503 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:36.801811 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.801787 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-8jf55"] Jul 01 17:51:36.803942 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:51:36.803914 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ef378e_1fb2_47fc_8487_21f647f58eae.slice/crio-dddbd45b666a4e8ad83e2efa43c0f1e0a3ba3844aefa09e24f4ff763456c7a3e WatchSource:0}: Error finding container dddbd45b666a4e8ad83e2efa43c0f1e0a3ba3844aefa09e24f4ff763456c7a3e: Status 404 returned error can't find the container with id dddbd45b666a4e8ad83e2efa43c0f1e0a3ba3844aefa09e24f4ff763456c7a3e Jul 01 17:51:36.805314 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:36.805293 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:51:37.128717 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:37.128549 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:51:37.207787 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:37.207614 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" event={"ID":"32ef378e-1fb2-47fc-8487-21f647f58eae","Type":"ContainerStarted","Data":"dddbd45b666a4e8ad83e2efa43c0f1e0a3ba3844aefa09e24f4ff763456c7a3e"} Jul 01 17:51:38.213230 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:38.213194 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" event={"ID":"32ef378e-1fb2-47fc-8487-21f647f58eae","Type":"ContainerStarted","Data":"6962b969e94b683d9544ace7ec74a3e4ae04d4009b9783117351d217b5ea7f37"} Jul 01 17:51:38.242300 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:38.242255 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" podStartSLOduration=1.1972378049999999 podStartE2EDuration="2.242240711s" totalImagesPullingTime="1.045002906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:51:38.242050954 +0000 UTC m=+750.749702558" watchObservedRunningTime="2026-07-01 17:51:38.242240711 +0000 UTC m=+750.749892319" Jul 01 17:51:42.817015 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:42.816977 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:51:44.917183 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:44.917152 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn"] Jul 01 17:51:44.923564 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:44.921898 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:44.926080 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:44.926055 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 01 17:51:44.942818 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:44.942797 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn"] Jul 01 17:51:44.994503 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:44.994475 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwkm5\" (UniqueName: \"kubernetes.io/projected/4b908863-7aa1-4911-b49f-4c8d6f928bfb-kube-api-access-qwkm5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:44.994616 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:44.994523 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b908863-7aa1-4911-b49f-4c8d6f928bfb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:44.994616 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:44.994560 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b908863-7aa1-4911-b49f-4c8d6f928bfb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:44.994616 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:44.994587 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b908863-7aa1-4911-b49f-4c8d6f928bfb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:44.994616 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:44.994610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b908863-7aa1-4911-b49f-4c8d6f928bfb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.095834 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.095786 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkm5\" (UniqueName: \"kubernetes.io/projected/4b908863-7aa1-4911-b49f-4c8d6f928bfb-kube-api-access-qwkm5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.095834 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.095845 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b908863-7aa1-4911-b49f-4c8d6f928bfb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.096069 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.095869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b908863-7aa1-4911-b49f-4c8d6f928bfb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.096069 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.095896 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b908863-7aa1-4911-b49f-4c8d6f928bfb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.096069 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.095917 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b908863-7aa1-4911-b49f-4c8d6f928bfb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.096431 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.096406 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b908863-7aa1-4911-b49f-4c8d6f928bfb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.096431 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.096419 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b908863-7aa1-4911-b49f-4c8d6f928bfb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.098293 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.098269 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b908863-7aa1-4911-b49f-4c8d6f928bfb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.098546 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.098530 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b908863-7aa1-4911-b49f-4c8d6f928bfb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.104254 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.104237 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwkm5\" (UniqueName: \"kubernetes.io/projected/4b908863-7aa1-4911-b49f-4c8d6f928bfb-kube-api-access-qwkm5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn\" (UID: \"4b908863-7aa1-4911-b49f-4c8d6f928bfb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.232975 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.232897 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:45.369603 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:45.369579 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn"] Jul 01 17:51:45.370985 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:51:45.370959 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b908863_7aa1_4911_b49f_4c8d6f928bfb.slice/crio-1205671a28f29d034ac7fbc97e538d3ad44b475708b939aaff1f34af812da9a2 WatchSource:0}: Error finding container 1205671a28f29d034ac7fbc97e538d3ad44b475708b939aaff1f34af812da9a2: Status 404 returned error can't find the container with id 1205671a28f29d034ac7fbc97e538d3ad44b475708b939aaff1f34af812da9a2 Jul 01 17:51:46.252140 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:46.252105 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" event={"ID":"4b908863-7aa1-4911-b49f-4c8d6f928bfb","Type":"ContainerStarted","Data":"11d1fa64636ff9bd383ad0f72488e2c64002116899ce4b3f4c298a54f5f017d4"} Jul 01 17:51:46.252517 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:46.252161 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" event={"ID":"4b908863-7aa1-4911-b49f-4c8d6f928bfb","Type":"ContainerStarted","Data":"1205671a28f29d034ac7fbc97e538d3ad44b475708b939aaff1f34af812da9a2"} Jul 01 17:51:46.281808 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:46.281760 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" podStartSLOduration=2.100616792 podStartE2EDuration="2.281745649s" totalImagesPullingTime="181.128857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:51:46.279836839 +0000 UTC m=+758.787488446" watchObservedRunningTime="2026-07-01 17:51:46.281745649 +0000 UTC m=+758.789397257" Jul 01 17:51:46.441346 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:46.441318 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:51:46.670071 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:46.670035 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:46.670217 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:46.670104 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:46.682238 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:46.682220 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:47.268536 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:47.268510 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8jf55" Jul 01 17:51:53.542401 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:53.542367 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:51:55.233576 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:55.233536 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:55.234045 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:55.233618 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:55.246463 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:55.246434 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:51:55.303580 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:51:55.303551 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn" Jul 01 17:52:14.929516 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:14.929486 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p"] Jul 01 17:52:14.935678 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:14.935638 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:14.942781 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:52:14.942749 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"premium-simulated-simulated-premium-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-140-89.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-140-89.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" type="*v1.Secret" Jul 01 17:52:14.949308 ip-10-0-140-89 kubenswrapper[2557]: E0701 17:52:14.949280 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" is forbidden: User \"system:node:ip-10-0-140-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-140-89.ec2.internal' and this object" podUID="92bac11d-a3ef-4794-af95-4634b042bd74" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:14.971292 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:14.971265 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p"] Jul 01 17:52:15.064375 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.064334 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92bac11d-a3ef-4794-af95-4634b042bd74-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.064375 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.064374 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92bac11d-a3ef-4794-af95-4634b042bd74-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.064584 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.064455 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92bac11d-a3ef-4794-af95-4634b042bd74-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.064584 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.064534 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92bac11d-a3ef-4794-af95-4634b042bd74-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.064691 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.064589 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh2jd\" (UniqueName: \"kubernetes.io/projected/92bac11d-a3ef-4794-af95-4634b042bd74-kube-api-access-wh2jd\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.166080 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.166044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92bac11d-a3ef-4794-af95-4634b042bd74-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.166231 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.166094 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92bac11d-a3ef-4794-af95-4634b042bd74-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.166231 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.166125 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2jd\" (UniqueName: \"kubernetes.io/projected/92bac11d-a3ef-4794-af95-4634b042bd74-kube-api-access-wh2jd\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.166231 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.166159 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92bac11d-a3ef-4794-af95-4634b042bd74-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.166231 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.166175 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92bac11d-a3ef-4794-af95-4634b042bd74-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.166466 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.166446 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92bac11d-a3ef-4794-af95-4634b042bd74-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.166519 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.166471 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92bac11d-a3ef-4794-af95-4634b042bd74-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.168548 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.168531 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92bac11d-a3ef-4794-af95-4634b042bd74-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.177350 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.177320 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh2jd\" (UniqueName: \"kubernetes.io/projected/92bac11d-a3ef-4794-af95-4634b042bd74-kube-api-access-wh2jd\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:15.873675 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.873613 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 01 17:52:15.879131 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:15.879112 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92bac11d-a3ef-4794-af95-4634b042bd74-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p\" (UID: \"92bac11d-a3ef-4794-af95-4634b042bd74\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:16.144595 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:16.144503 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:16.290911 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:16.290557 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p"] Jul 01 17:52:16.386383 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:16.386347 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" event={"ID":"92bac11d-a3ef-4794-af95-4634b042bd74","Type":"ContainerStarted","Data":"b0f1dedbf6ac60fdac878ee8f79f0135129427e2c1e7a239f500c326564f146f"} Jul 01 17:52:16.431759 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:16.431668 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9bs6v"] Jul 01 17:52:17.400998 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:17.400964 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" event={"ID":"92bac11d-a3ef-4794-af95-4634b042bd74","Type":"ContainerStarted","Data":"60c5fa0d03eb45d8436aa319c9d22391620233a36d8fe47c6dc093b8d45a2ca1"} Jul 01 17:52:17.439162 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:17.439109 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" podStartSLOduration=3.199545034 podStartE2EDuration="3.439093123s" totalImagesPullingTime="239.548089ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:52:17.437069895 +0000 UTC m=+789.944721506" watchObservedRunningTime="2026-07-01 17:52:17.439093123 +0000 UTC m=+789.946744730" Jul 01 17:52:26.145096 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:26.145060 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:26.145474 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:26.145154 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:26.157579 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:26.157557 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:52:26.453904 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:52:26.453829 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p" Jul 01 17:54:07.912914 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:07.912883 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4tzt_4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2/ovn-acl-logging/0.log" Jul 01 17:54:07.914676 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:07.914635 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z4tzt_4cd36b5a-fe95-4e3e-916a-aba4f9fe2ec2/ovn-acl-logging/0.log" Jul 01 17:54:31.967747 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:31.967720 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c9b6b59-fwnx9_0be5f807-c132-467a-b72b-5ed763647adc/copy-manifests/0.log" Jul 01 17:54:31.980718 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:31.980689 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c9b6b59-fwnx9_0be5f807-c132-467a-b72b-5ed763647adc/manager/0.log" Jul 01 17:54:33.872247 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:33.872220 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-khpfc_b999f861-65be-45b4-8d7e-f0d1a44dbdad/manager/0.log" Jul 01 17:54:33.994404 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:33.994371 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-79wzz_13cac9fa-c64c-4dd3-8059-af99ec0ef7d1/manager/0.log" Jul 01 17:54:34.508946 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:34.508920 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9bs6v_eb2357e0-89d2-44e5-90aa-1779734bd4fc/limitador/0.log" Jul 01 17:54:35.220138 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:35.220078 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6647fbf6bf-4976f_410a9d39-c277-4056-ba45-ab345e66beda/kube-auth-proxy/0.log" Jul 01 17:54:36.268360 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:36.268319 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-ff95456df-8jf55_32ef378e-1fb2-47fc-8487-21f647f58eae/main/0.log" Jul 01 17:54:36.511336 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:36.511287 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649xqffn_4b908863-7aa1-4911-b49f-4c8d6f928bfb/main/0.log" Jul 01 17:54:36.748548 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:36.748521 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6cfb9f9b9c-vx46p_92bac11d-a3ef-4794-af95-4634b042bd74/main/0.log" Jul 01 17:54:40.678235 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.678204 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jskq7/must-gather-sfzcs"] Jul 01 17:54:40.681664 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.681615 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jskq7/must-gather-sfzcs" Jul 01 17:54:40.685700 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.685679 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jskq7\"/\"kube-root-ca.crt\"" Jul 01 17:54:40.686963 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.686931 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jskq7\"/\"default-dockercfg-rcm95\"" Jul 01 17:54:40.687114 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.686936 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jskq7\"/\"openshift-service-ca.crt\"" Jul 01 17:54:40.703161 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.703138 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jskq7/must-gather-sfzcs"] Jul 01 17:54:40.795386 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.795362 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fspt8\" (UniqueName: \"kubernetes.io/projected/437cb217-3303-417d-bb38-3e4285e1e3c7-kube-api-access-fspt8\") pod \"must-gather-sfzcs\" (UID: \"437cb217-3303-417d-bb38-3e4285e1e3c7\") " pod="openshift-must-gather-jskq7/must-gather-sfzcs" Jul 01 17:54:40.795544 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.795392 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/437cb217-3303-417d-bb38-3e4285e1e3c7-must-gather-output\") pod \"must-gather-sfzcs\" (UID: \"437cb217-3303-417d-bb38-3e4285e1e3c7\") " pod="openshift-must-gather-jskq7/must-gather-sfzcs" Jul 01 17:54:40.896962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.896930 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fspt8\" (UniqueName: \"kubernetes.io/projected/437cb217-3303-417d-bb38-3e4285e1e3c7-kube-api-access-fspt8\") pod \"must-gather-sfzcs\" (UID: \"437cb217-3303-417d-bb38-3e4285e1e3c7\") " pod="openshift-must-gather-jskq7/must-gather-sfzcs" Jul 01 17:54:40.896962 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.896964 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/437cb217-3303-417d-bb38-3e4285e1e3c7-must-gather-output\") pod \"must-gather-sfzcs\" (UID: \"437cb217-3303-417d-bb38-3e4285e1e3c7\") " pod="openshift-must-gather-jskq7/must-gather-sfzcs" Jul 01 17:54:40.897351 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.897333 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/437cb217-3303-417d-bb38-3e4285e1e3c7-must-gather-output\") pod \"must-gather-sfzcs\" (UID: \"437cb217-3303-417d-bb38-3e4285e1e3c7\") " pod="openshift-must-gather-jskq7/must-gather-sfzcs" Jul 01 17:54:40.912762 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.912736 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fspt8\" (UniqueName: \"kubernetes.io/projected/437cb217-3303-417d-bb38-3e4285e1e3c7-kube-api-access-fspt8\") pod \"must-gather-sfzcs\" (UID: \"437cb217-3303-417d-bb38-3e4285e1e3c7\") " pod="openshift-must-gather-jskq7/must-gather-sfzcs" Jul 01 17:54:40.990587 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:40.990521 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jskq7/must-gather-sfzcs" Jul 01 17:54:41.127183 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:41.127156 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jskq7/must-gather-sfzcs"] Jul 01 17:54:41.128662 ip-10-0-140-89 kubenswrapper[2557]: W0701 17:54:41.128616 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod437cb217_3303_417d_bb38_3e4285e1e3c7.slice/crio-17261ca20c5f3370aa751765bec3addb6e67f38009ada42312875d7ae757c932 WatchSource:0}: Error finding container 17261ca20c5f3370aa751765bec3addb6e67f38009ada42312875d7ae757c932: Status 404 returned error can't find the container with id 17261ca20c5f3370aa751765bec3addb6e67f38009ada42312875d7ae757c932 Jul 01 17:54:42.065712 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:42.065673 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jskq7/must-gather-sfzcs" event={"ID":"437cb217-3303-417d-bb38-3e4285e1e3c7","Type":"ContainerStarted","Data":"17261ca20c5f3370aa751765bec3addb6e67f38009ada42312875d7ae757c932"} Jul 01 17:54:43.074719 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:43.074680 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jskq7/must-gather-sfzcs" event={"ID":"437cb217-3303-417d-bb38-3e4285e1e3c7","Type":"ContainerStarted","Data":"ef522dadf1e4252fcf6ba3088412b931033134c83c6ac3dbb694db164d7bacdc"} Jul 01 17:54:43.075117 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:43.074735 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jskq7/must-gather-sfzcs" event={"ID":"437cb217-3303-417d-bb38-3e4285e1e3c7","Type":"ContainerStarted","Data":"b9a8a004f99038cd42911fb65ab25389c4964ead989e0ec27277fe9ba62f49b3"} Jul 01 17:54:44.075604 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:44.075564 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nh728_35e8d50c-f601-4840-8909-8d462a7d6953/global-pull-secret-syncer/0.log" Jul 01 17:54:44.223374 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:44.223335 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n77l4_773871da-d67a-452f-8acc-b169f6dd8711/konnectivity-agent/0.log" Jul 01 17:54:44.346437 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:44.346366 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-89.ec2.internal_7a26dcbe7740a0418a5dbe53bf94c782/haproxy/0.log" Jul 01 17:54:48.981419 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:48.981380 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-khpfc_b999f861-65be-45b4-8d7e-f0d1a44dbdad/manager/0.log" Jul 01 17:54:49.029881 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:49.029855 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-79wzz_13cac9fa-c64c-4dd3-8059-af99ec0ef7d1/manager/0.log" Jul 01 17:54:49.229433 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:49.229384 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9bs6v_eb2357e0-89d2-44e5-90aa-1779734bd4fc/limitador/0.log" Jul 01 17:54:51.137005 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.136923 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-gxjb2_b2384345-9f55-49e3-9dae-21b506857126/cluster-monitoring-operator/0.log" Jul 01 17:54:51.195596 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.195559 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-mslhn_c2ffda4a-2647-449d-8a9f-ef7ba55efba5/kube-state-metrics/0.log" Jul 01 17:54:51.220705 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.220679 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-mslhn_c2ffda4a-2647-449d-8a9f-ef7ba55efba5/kube-rbac-proxy-main/0.log" Jul 01 17:54:51.262994 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.262941 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-mslhn_c2ffda4a-2647-449d-8a9f-ef7ba55efba5/kube-rbac-proxy-self/0.log" Jul 01 17:54:51.366733 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.366703 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-hbxw2_9f7998f5-3ae4-4b31-8e16-d1a05a2d1f7a/monitoring-plugin/0.log" Jul 01 17:54:51.612831 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.612801 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5jdg_fdc3a7b2-6034-4d1a-8a71-e2652caee88d/node-exporter/0.log" Jul 01 17:54:51.641665 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.641603 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5jdg_fdc3a7b2-6034-4d1a-8a71-e2652caee88d/kube-rbac-proxy/0.log" Jul 01 17:54:51.668607 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.668577 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5jdg_fdc3a7b2-6034-4d1a-8a71-e2652caee88d/init-textfile/0.log" Jul 01 17:54:51.850325 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.850293 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3a42b7c-bdff-4516-9232-954a72b35958/prometheus/0.log" Jul 01 17:54:51.880597 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.880561 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3a42b7c-bdff-4516-9232-954a72b35958/config-reloader/0.log" Jul 01 17:54:51.913175 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.913150 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3a42b7c-bdff-4516-9232-954a72b35958/thanos-sidecar/0.log" Jul 01 17:54:51.943558 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.943526 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3a42b7c-bdff-4516-9232-954a72b35958/kube-rbac-proxy-web/0.log" Jul 01 17:54:51.970876 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.970841 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3a42b7c-bdff-4516-9232-954a72b35958/kube-rbac-proxy/0.log" Jul 01 17:54:51.998751 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:51.998716 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3a42b7c-bdff-4516-9232-954a72b35958/kube-rbac-proxy-thanos/0.log" Jul 01 17:54:52.036412 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:52.036379 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3a42b7c-bdff-4516-9232-954a72b35958/init-config-reloader/0.log" Jul 01 17:54:52.266140 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:52.266116 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668999d584-8kzfl_0fde2491-da20-4075-9b10-711dfe2675ad/thanos-query/0.log" Jul 01 17:54:52.291628 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:52.291580 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668999d584-8kzfl_0fde2491-da20-4075-9b10-711dfe2675ad/kube-rbac-proxy-web/0.log" Jul 01 17:54:52.317668 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:52.317565 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668999d584-8kzfl_0fde2491-da20-4075-9b10-711dfe2675ad/kube-rbac-proxy/0.log" Jul 01 17:54:52.344315 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:52.344287 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668999d584-8kzfl_0fde2491-da20-4075-9b10-711dfe2675ad/prom-label-proxy/0.log" Jul 01 17:54:52.377157 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:52.377096 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668999d584-8kzfl_0fde2491-da20-4075-9b10-711dfe2675ad/kube-rbac-proxy-rules/0.log" Jul 01 17:54:52.407092 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:52.407068 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668999d584-8kzfl_0fde2491-da20-4075-9b10-711dfe2675ad/kube-rbac-proxy-metrics/0.log" Jul 01 17:54:53.651173 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:53.651144 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-vc96z_4ff6219f-dcf7-4588-a127-15daffea131b/networking-console-plugin/0.log" Jul 01 17:54:55.621023 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:55.620995 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-rn5zx_bcce152d-7b21-42cc-8945-c8cf864d6f61/volume-data-source-validator/0.log" Jul 01 17:54:56.927986 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:56.927961 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qqlpj_d789de5a-1fb9-4e71-86b6-3d6bb86cd5af/dns/0.log" Jul 01 17:54:56.965782 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:56.965759 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qqlpj_d789de5a-1fb9-4e71-86b6-3d6bb86cd5af/kube-rbac-proxy/0.log" Jul 01 17:54:57.018882 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.018845 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b7zv7_8829ddc0-02b1-483f-8009-73c4c83f6935/dns-node-resolver/0.log" Jul 01 17:54:57.530417 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.530321 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jskq7/must-gather-sfzcs" podStartSLOduration=16.444139337 podStartE2EDuration="17.5302971s" totalImagesPullingTime="1.086157763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:54:43.112315853 +0000 UTC m=+935.619967462" watchObservedRunningTime="2026-07-01 17:54:57.5302971 +0000 UTC m=+950.037948709" Jul 01 17:54:57.532504 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.532475 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27"] Jul 01 17:54:57.550671 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.550409 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27"] Jul 01 17:54:57.550671 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.550525 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.586407 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.586373 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-sys\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.586574 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.586510 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5w22\" (UniqueName: \"kubernetes.io/projected/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-kube-api-access-j5w22\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.586574 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.586547 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-proc\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.586713 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.586692 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-lib-modules\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.586763 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.586730 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-podres\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.687451 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.687413 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-lib-modules\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.687615 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.687461 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-podres\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.687615 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.687501 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-sys\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.687615 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.687573 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-lib-modules\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.687615 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.687598 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5w22\" (UniqueName: \"kubernetes.io/projected/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-kube-api-access-j5w22\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.687830 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.687630 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-proc\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.687830 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.687576 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-sys\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.687830 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.687698 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-proc\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.687830 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.687576 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-podres\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.699089 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.699057 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5w22\" (UniqueName: \"kubernetes.io/projected/61e6b8c1-96c4-4c8a-8d17-d658d3f35480-kube-api-access-j5w22\") pod \"perf-node-gather-daemonset-2ps27\" (UID: \"61e6b8c1-96c4-4c8a-8d17-d658d3f35480\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.867828 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.867797 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:57.887086 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:57.887059 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qkp44_61e0159e-4247-4c24-9783-f9cd8c368db9/node-ca/0.log" Jul 01 17:54:58.035171 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:58.035133 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27"] Jul 01 17:54:58.176860 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:58.176777 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" event={"ID":"61e6b8c1-96c4-4c8a-8d17-d658d3f35480","Type":"ContainerStarted","Data":"931be3cb2c2c5d3c1b186553eb0c271da133bbb4742b03ab5c947c1147ea686e"} Jul 01 17:54:59.184287 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:59.184254 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" event={"ID":"61e6b8c1-96c4-4c8a-8d17-d658d3f35480","Type":"ContainerStarted","Data":"49486364992f3d7eb228ee25e8612cadecdf77f2dfd60252cd899a6a5ccba279"} Jul 01 17:54:59.184670 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:59.184433 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:54:59.206587 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:59.206540 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" podStartSLOduration=2.206523337 podStartE2EDuration="2.206523337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:54:59.204936021 +0000 UTC m=+951.712587631" watchObservedRunningTime="2026-07-01 17:54:59.206523337 +0000 UTC m=+951.714174946" Jul 01 17:54:59.224372 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:54:59.224342 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6647fbf6bf-4976f_410a9d39-c277-4056-ba45-ab345e66beda/kube-auth-proxy/0.log" Jul 01 17:55:00.075860 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:00.075825 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7dtjb_f661b214-e959-4c69-97f8-6d440c8d965f/serve-healthcheck-canary/0.log" Jul 01 17:55:00.829606 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:00.829583 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d79pv_105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51/kube-rbac-proxy/0.log" Jul 01 17:55:00.892853 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:00.892827 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d79pv_105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51/exporter/0.log" Jul 01 17:55:00.947924 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:00.947897 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d79pv_105f2e7a-e3ca-43cb-bd8a-b9faecbd2c51/extractor/0.log" Jul 01 17:55:04.401115 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:04.401084 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c9b6b59-fwnx9_0be5f807-c132-467a-b72b-5ed763647adc/manager/0.log" Jul 01 17:55:04.401771 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:04.401747 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6647fbf6bf-4976f_410a9d39-c277-4056-ba45-ab345e66beda/kube-auth-proxy/0.log" Jul 01 17:55:04.445960 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:04.445936 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c9b6b59-fwnx9_0be5f807-c132-467a-b72b-5ed763647adc/copy-manifests/0.log" Jul 01 17:55:05.202422 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:05.202396 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-2ps27" Jul 01 17:55:05.722994 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:05.722957 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6647fbf6bf-4976f_410a9d39-c277-4056-ba45-ab345e66beda/kube-auth-proxy/0.log" Jul 01 17:55:06.170877 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:06.170842 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6599c59cb5-k5dj5_7510f352-57e6-4760-8ce0-a1fb85df36b3/manager/0.log" Jul 01 17:55:11.942377 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:11.942339 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-9xvkx_ac15f280-6a24-44fb-b6a3-83487bcc1319/kube-storage-version-migrator-operator/1.log" Jul 01 17:55:11.943271 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:11.943246 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-9xvkx_ac15f280-6a24-44fb-b6a3-83487bcc1319/kube-storage-version-migrator-operator/0.log" Jul 01 17:55:13.491042 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:13.491018 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzwq5_5872131c-cc29-4fa7-8687-a9658d15532b/kube-multus-additional-cni-plugins/0.log" Jul 01 17:55:13.525587 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:13.525560 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzwq5_5872131c-cc29-4fa7-8687-a9658d15532b/egress-router-binary-copy/0.log" Jul 01 17:55:13.557403 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:13.557380 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzwq5_5872131c-cc29-4fa7-8687-a9658d15532b/cni-plugins/0.log" Jul 01 17:55:13.583416 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:13.583391 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzwq5_5872131c-cc29-4fa7-8687-a9658d15532b/bond-cni-plugin/0.log" Jul 01 17:55:13.621984 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:13.621961 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzwq5_5872131c-cc29-4fa7-8687-a9658d15532b/routeoverride-cni/0.log" Jul 01 17:55:13.652418 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:13.652400 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzwq5_5872131c-cc29-4fa7-8687-a9658d15532b/whereabouts-cni-bincopy/0.log" Jul 01 17:55:13.682802 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:13.682775 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzwq5_5872131c-cc29-4fa7-8687-a9658d15532b/whereabouts-cni/0.log" Jul 01 17:55:13.722246 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:13.722223 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tsmc7_02fb1131-5a5f-4faf-8ab0-3d755acb8c2b/kube-multus/0.log" Jul 01 17:55:13.942284 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:13.942252 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qvjbt_e9405216-0c3e-46c9-9d9d-d4904fccd18f/network-metrics-daemon/0.log" Jul 01 17:55:13.966614 ip-10-0-140-89 kubenswrapper[2557]: I0701 17:55:13.966595 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qvjbt_e9405216-0c3e-46c9-9d9d-d4904fccd18f/kube-rbac-proxy/0.log"